00000001:02000400:1.0F:1788969736.158821:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788969744.476325:0:3161:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788969745.406056:0:3220:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1359 MB/s 00000001:01000000:2.0:1788969745.656413:0:3220:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1715 MB/s 00000001:01000000:2.0:1788969745.908873:0:3220:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4252 MB/s 00000020:02000000:0.0F:1788969747.069431:0:3252:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_42_gf11d80b 00000400:02000000:0.0:1788969747.908643:0:3267:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.109@tcp [8/256/0/180] 00008000:02000000:2.0:1788969751.906707:0:3417:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788969815.766052:0:5227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788969825.278731:0:5813:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788969825.278737:0:5813:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788969825.283991:0:5813:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000088bc1133 00000080:02000400:1.0:1788969825.284008:0:5813:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788969825.292357:0:5813:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788969825.292370:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788969825.292922:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000000423904) 00000020:00000080:0.0:1788969825.293095:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788969825.313042:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788969825.313424:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788969825.337444:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788969825.337485:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788969825.337506:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788969825.337573:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788969825.337674:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788969825.338445:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788969825.338454:0:5813:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788969825.338465:0:5813:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b37b6 00000020:01000004:3.0:1788969825.338472:0:5813:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788969825.338477:0:5813:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788969825.338482:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000088bc1133 from MGS 00000020:01000004:3.0:1788969825.338486:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788969825.338504:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005e3220ed) 00000020:00000080:3.0:1788969825.338515:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788969825.338618:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000088bc1133 from MGS, refs=2 00080000:01000000:3.0:1788969825.338623:0:5813:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788969825.338630:0:5813:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b37c4 00000100:00100000:3.0:1788969825.338727:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788969825.339179:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788969825.339184:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788969825.339919:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788969825.339994:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788969825.341047:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788969825.341208:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788969825.341214:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788969825.341873:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788969825.341880:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788969825.342276:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788969825.342293:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788969825.343361:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969825.343366:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969825.343367:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969825.343744:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969825.343747:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969825.343748:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969825.344482:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788969825.353367:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788969825.594175:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3851 MB/s 00000001:01000000:0.0:1788969825.843903:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2743 MB/s 00000001:01000000:2.0:1788969826.093982:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 411 MB/s 00000001:01000000:0.0:1788969826.343935:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 619 MB/s 00080000:10000000:2.0:1788969826.353050:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788969826.374522:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788969826.374540:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788969826.374542:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1788969826.383918:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788969826.384533:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788969826.384595:0:5813:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788969826.384667:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788969826.385647:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788969826.385676:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788969826.386323:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788969826.386966:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788969826.386973:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788969826.387935:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788969826.387957:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788969826.388732:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788969826.388741:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788969826.389455:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788969826.389479:0:5813:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.109@tcp' 00000020:01000004:1.0:1788969826.389481:0:5813:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788969826.389528:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.109@tcp (typ=mgc) 00000020:00000080:1.0:1788969826.389546:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.109@tcp (000000004a2d0c74) 00000020:00000080:1.0:1788969826.389561:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788969826.389683:0:5813:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002f0dc2ad@MGC192.168.202.109@tcp: add connection 192.168.202.109@tcp at head 00010000:00010000:1.0:1788969826.389867:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.109@tcp-0 is initialized 00000040:01000000:1.0:1788969826.389873:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788969826.392508:0:5828:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788969826.397084:0:5829:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788969826.397129:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.109@tcp (uuid 1d87485c-d221-41b3-b6c0-56f4dfc97796) 00000020:00000080:0.0:1788969826.397153:0:5813:0:(genops.c:1384:class_connect()) connect: client 1d87485c-d221-41b3-b6c0-56f4dfc97796, cookie 0x5d0de860b05b37d2 00000100:00080000:0.0:1788969826.397166:0:5813:0:(import.c:545:import_select_connection()) MGC192.168.202.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788969826.397176:0:5813:0:(import.c:666:import_select_connection()) MGC192.168.202.109@tcp: import 000000002f0dc2ad using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788969826.397212:0:5813:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ddbff9d x1875870741430400/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788969826.397232:0:5813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1d87485c-d221-41b3-b6c0-56f4dfc97796->MGS 00000100:00100000:3.0:1788969826.397853:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ddbff9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1d87485c-d221-41b3-b6c0-56f4dfc97796:3282:1875870741430400:0@lo:250: 00000100:00100000:3.0:1788969826.397953:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969826.400263:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741430400 00000100:00100000:1.0:1788969826.400275:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741430400 00000100:00100000:1.0:1788969826.400312:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788969826.400319:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b11b2a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875870741430400:12345-0@lo:250: 00010000:00080000:1.0:1788969826.400342:0:5825:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 1d87485c-d221-41b3-b6c0-56f4dfc97796@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:1.0:1788969826.400380:0:5825:0:(genops.c:1384:class_connect()) connect: client 1d87485c-d221-41b3-b6c0-56f4dfc97796, cookie 0x5d0de860b05b37d9 00000100:00080000:1.0:1788969826.400518:0:5825:0:(import.c:65:import_set_state_nolock()) 00000000f50769c9 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788969826.400608:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b11b2a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:3282:x1875870741430400:12345-0@lo:250: Request processed in 288us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969826.400616:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788969826.403228:0:3282:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788969826.403243:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.109@tcp: connect to target with instance 0 00000100:00080000:3.0:1788969826.403251:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788969826.403256:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788969826.403260:0:3282:0:(import.c:65:import_set_state_nolock()) 000000002f0dc2ad MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788969826.403263:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788969826.403274:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788969826.403439:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ddbff9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1d87485c-d221-41b3-b6c0-56f4dfc97796:3282:1875870741430400:0@lo:250: 00000020:01000004:0.0:1788969826.407618:0:5813:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788969826.411449:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788969826.411480:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000137c2073) 00000020:00000080:2.0:1788969826.411498:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788969826.467650:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788969826.468135:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788969826.468141:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788969826.472718:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788969826.472758:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788969826.474629:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788969826.474642:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788969826.475471:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788969826.475658:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788969826.475663:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788969826.478768:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788969826.478782:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788969826.563067:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788969826.563303:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788969826.563310:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788969826.570399:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788969826.570413:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788969826.574769:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788969826.575009:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788969826.575016:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788969826.576977:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788969826.576988:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788969826.577632:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788969826.578057:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788969826.578064:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788969826.581627:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788969826.581642:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788969826.583324:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788969826.583496:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788969826.583501:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788969826.585109:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788969826.585121:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788969826.635028:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788969826.635238:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788969826.635245:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788969826.641155:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788969826.641172:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788969826.643920:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788969826.643935:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788969826.645473:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788969826.645497:0:5813:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788969826.645503:0:5813:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788969826.645713:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788969826.645752:0:5813:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788969826.645756:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788969826.645757:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788969826.645759:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788969826.645760:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788969826.645761:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788969826.645762:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788969826.645763:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788969826.645765:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788969826.645766:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788969826.645767:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788969826.645769:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788969826.645770:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788969826.645777:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788969826.645779:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788969826.645780:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788969826.645781:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788969826.645782:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788969826.645782:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788969826.645783:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788969826.645784:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788969826.645785:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788969826.645785:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788969826.645786:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788969826.645942:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788969826.645943:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788969826.645968:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788969826.645991:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741430528:0@lo:253: 00000100:00100000:3.0:1788969826.646065:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969826.646160:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e524afc6 going to sleep for 11 seconds 00000100:00100000:1.0:1788969826.646620:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741430528 00000100:00100000:1.0:1788969826.646629:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741430528 00000100:00100000:1.0:1788969826.646717:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788969826.646726:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f510a34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:5813:x1875870741430528:12345-0@lo:253: 20000000:01000000:1.0:1788969826.646773:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788969826.646776:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788969826.647088:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788969826.647145:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788969826.647439:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788969826.648695:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788969826.649294:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788969826.649299:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788969826.649315:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788969826.649318:0:5827:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788969826.649334:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788969826.649704:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788969826.650146:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788969826.650161:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788969826.650207:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788969826.650254:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788969826.650289:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788969826.650466:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788969826.650476:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788969826.650605:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788969826.650615:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788969826.650652:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788969826.650660:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788969826.650710:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788969826.650763:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788969826.650989:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788969826.650996:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788969826.651009:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788969826.651194:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788969826.651206:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788969826.651240:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788969826.651271:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788969826.651312:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788969826.651324:0:5827:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788969826.651485:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788969826.651495:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788969826.651629:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788969826.651670:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788969826.651705:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788969826.651716:0:5827:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788969826.651916:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788969826.651928:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788969826.651964:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788969826.651999:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788969826.652175:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788969826.652226:0:5827:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788969826.652233:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788969826.653056:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788969826.653589:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788969826.653613:0:5827:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.109@tcp for mdt 20000000:01000000:1.0:1788969826.653615:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:1.0:1788969826.653653:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788969826.653661:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788969826.653693:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788969826.653701:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:1.0:1788969826.656104:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788969826.656136:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788969826.656217:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788969826.656256:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788969826.656378:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788969826.656381:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788969826.656385:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788969826.656396:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788969826.656398:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788969826.656427:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788969826.656429:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788969826.657193:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788969826.657449:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788969826.657485:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788969826.657564:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788969826.657588:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788969826.657590:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788969826.658167:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788969826.658504:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788969826.658560:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788969826.658711:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788969826.658727:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788969826.658739:0:5827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788969826.658745:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788969826.658748:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788969826.658752:0:5827:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788969826.658759:0:5827:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788969826.659223:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788969826.659335:0:5827:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788969826.674775:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788969826.675048:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788969826.675127:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788969826.675149:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788969826.675170:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675186:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675195:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675202:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675207:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675214:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675219:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c43081b7 already unused, calling callback (000000008f3987d0) 00010000:00010000:0.0:1788969826.675222:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675241:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675252:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675259:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969826.675263:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c43081b7/0x5d0de860b05b37e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788969826.675278:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788969826.966157:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f510a34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:5813:x1875870741430528:12345-0@lo:253: Request processed in 319424us (320085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969826.966177:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788969826.966265:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741430528:0@lo:253: 10000000:01000000:3.0:1788969826.966281:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788969826.966284:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788969826.966286:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788969826.966287:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788969826.966289:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788969826.966291:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788969826.966292:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788969826.966293:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788969826.966295:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788969826.966296:0:5813:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788969826.966298:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788969826.966299:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788969826.966319:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000088bc1133 from lustre-MDT0000 10000000:01000000:3.0:1788969826.966343:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788969826.966346:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788969826.966350:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9778652a99c0 10000000:01000000:3.0:1788969826.966360:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788969826.966368:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9778652a99c0 from 1 10000000:01000000:3.0:1788969826.966371:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788969826.966405:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 0000000056c017e9/0x5d0de860b05b37ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.966416:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 0000000056c017e9/0x5d0de860b05b37ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.966424:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 0000000056c017e9/0x5d0de860b05b37ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969826.966442:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741430656:0@lo:101: 00000100:00100000:3.0:1788969826.966476:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969826.966649:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1c48298 going to sleep for 11 seconds 00000100:00100000:1.0:1788969826.966756:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741430656 00000100:00100000:1.0:1788969826.966763:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741430656 00000100:00100000:1.0:1788969826.966901:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788969826.966986:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000021818278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:5813:x1875870741430656:12345-0@lo:101: 00010000:00010000:1.0:1788969826.967000:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969826.967093:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba7e1479/0x5d0de860b05b37f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b37ee expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969826.967114:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba7e1479/0x5d0de860b05b37f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b37ee expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969826.967124:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba7e1479/0x5d0de860b05b37f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b37ee expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969826.967131:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba7e1479, rc 0) 00000100:00100000:1.0:1788969826.967175:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000021818278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+6:5813:x1875870741430656:12345-0@lo:101: Request processed in 267us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969826.967180:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788969826.967249:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741430656:0@lo:101: 00010000:00010000:3.0:1788969826.967262:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 0000000056c017e9/0x5d0de860b05b37ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.967270:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 0000000056c017e9/0x5d0de860b05b37ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969826.967315:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741430784:0@lo:501: 00000100:00100000:3.0:1788969826.967339:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969826.967487:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1c48298 going to sleep for 11 seconds 00000100:00100000:1.0:1788969826.967629:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741430784 00000100:00100000:1.0:1788969826.967634:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741430784 00000100:00100000:1.0:1788969826.967653:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788969826.967659:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000389355e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+6:5813:x1875870741430784:12345-0@lo:501: 00000100:00100000:1.0:1788969826.967893:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000389355e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+6:5813:x1875870741430784:12345-0@lo:501: Request processed in 234us (554us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788969826.967900:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788969826.968047:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741430784:0@lo:501: 10000000:01000000:3.0:1788969826.968072:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788969826.968092:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 0000000056c017e9/0x5d0de860b05b37ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.968106:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 0000000056c017e9/0x5d0de860b05b37ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969826.968113:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97786f03a800 10000000:01000000:3.0:1788969826.968117:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788969826.968121:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97786f03a800 10000000:01000000:3.0:1788969826.968123:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788969826.968126:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97786f03a800 from 1 10000000:01000000:3.0:1788969826.968128:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788969826.968144:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 000000002f1fe9de/0x5d0de860b05b37fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.968150:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 000000002f1fe9de/0x5d0de860b05b37fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.968156:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 000000002f1fe9de/0x5d0de860b05b37fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969826.968166:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741430912:0@lo:101: 00000100:00100000:3.0:1788969826.968189:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969826.968206:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1c48298 going to sleep for 11 seconds 00000100:00100000:1.0:1788969826.968266:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741430912 00000100:00100000:1.0:1788969826.968271:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741430912 00000100:00100000:1.0:1788969826.968287:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788969826.968292:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea9df8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+6:5813:x1875870741430912:12345-0@lo:101: 00010000:00010000:1.0:1788969826.968299:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969826.968308:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092426015/0x5d0de860b05b3803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b37fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969826.968320:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092426015/0x5d0de860b05b3803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b37fc expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969826.968338:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092426015/0x5d0de860b05b3803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b37fc expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969826.968345:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092426015, rc 0) 00000100:00100000:1.0:1788969826.968379:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea9df8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+7:5813:x1875870741430912:12345-0@lo:101: Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969826.968385:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788969826.968531:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741430912:0@lo:101: 00010000:00010000:3.0:1788969826.968542:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 000000002f1fe9de/0x5d0de860b05b37fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.968549:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 000000002f1fe9de/0x5d0de860b05b37fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969826.968572:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788969826.968585:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 000000002f1fe9de/0x5d0de860b05b37fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.968592:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 000000002f1fe9de/0x5d0de860b05b37fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969826.968598:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788969826.968601:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788969826.968605:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97786f03a800 10000000:01000000:3.0:1788969826.968607:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788969826.968610:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788969826.968612:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788969826.968625:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 00000000bdeff810/0x5d0de860b05b380a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.968631:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 00000000bdeff810/0x5d0de860b05b380a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.968637:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 00000000bdeff810/0x5d0de860b05b380a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969826.968648:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431040:0@lo:101: 00000100:00100000:3.0:1788969826.968672:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969826.968685:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1c48298 going to sleep for 11 seconds 00000100:00100000:1.0:1788969826.968825:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741431040 00000100:00100000:1.0:1788969826.968830:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741431040 00000100:00100000:1.0:1788969826.968849:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788969826.968854:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d1146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+7:5813:x1875870741431040:12345-0@lo:101: 00010000:00010000:1.0:1788969826.968861:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969826.968869:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000388a571/0x5d0de860b05b3811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b380a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969826.968880:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000388a571/0x5d0de860b05b3811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b380a expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969826.968887:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000388a571/0x5d0de860b05b3811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b380a expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969826.968893:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000388a571, rc 0) 00000100:00100000:1.0:1788969826.968934:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d1146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+8:5813:x1875870741431040:12345-0@lo:101: Request processed in 80us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969826.968939:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788969826.969120:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431040:0@lo:101: 00010000:00010000:3.0:1788969826.969130:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 00000000bdeff810/0x5d0de860b05b380a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969826.969147:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 00000000bdeff810/0x5d0de860b05b380a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969826.969190:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431168:0@lo:501: 00000100:00100000:3.0:1788969826.969217:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969826.969248:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1c48298 going to sleep for 11 seconds 00000100:00100000:1.0:1788969826.969304:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741431168 00000100:00100000:1.0:1788969826.969309:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741431168 00000100:00100000:1.0:1788969826.969327:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788969826.969339:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1839991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+8:5813:x1875870741431168:12345-0@lo:501: 00000100:00100000:1.0:1788969826.969637:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1839991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:5813:x1875870741431168:12345-0@lo:501: Request processed in 298us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969826.969645:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788969826.969723:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431168:0@lo:501: 00000100:00100000:3.0:1788969826.969751:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431296:0@lo:503: 00000100:00100000:3.0:1788969826.969852:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969826.969878:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1c48298 going to sleep for 11 seconds 00000100:00100000:1.0:1788969826.970048:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741431296 00000100:00100000:1.0:1788969826.970053:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741431296 00000100:00100000:1.0:1788969826.970072:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788969826.970077:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052d51ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:5813:x1875870741431296:12345-0@lo:503: 00000100:00100000:1.0:1788969826.970248:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052d51ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:5813:x1875870741431296:12345-0@lo:503: Request processed in 170us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969826.970256:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788969826.970401:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431296:0@lo:503: 00000100:00100000:1.0:1788969826.970855:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:5855:1875870741431424:0@lo:502: 00000100:00100000:1.0:1788969826.970897:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969826.970997:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e145a3d going to sleep for 11 seconds 00000100:00100000:3.0:1788969826.971069:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741431424 00000100:00100000:3.0:1788969826.971074:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741431424 00000100:00100000:3.0:1788969826.971107:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788969826.971114:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c458ed6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:5855:x1875870741431424:12345-0@lo:502: 00000100:00100000:3.0:1788969826.971295:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c458ed6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:5855:x1875870741431424:12345-0@lo:502: Request processed in 182us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969826.971302:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788969826.971429:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:5855:1875870741431424:0@lo:502: 00000020:01000000:1.0:1788969826.971457:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788969826.971467:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969826.971470:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788969826.971475:0:5855:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788969826.971479:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788969826.971492:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000799772ef) 00000020:00000080:1.0:1788969826.971513:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788969826.971533:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788969826.971612:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788969826.971620:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b381f 00000020:00000080:1.0:1788969826.971884:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788969826.971889:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788969826.971893:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969826.971899:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788969826.971902:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788969826.971905:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969826.971906:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788969826.972052:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788969826.972062:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000090cc4713) 00000020:00000080:1.0:1788969826.972072:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788969826.972077:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788969826.972079:0:5855:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788969826.972082:0:5855:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788969826.972087:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788969826.972137:0:5855:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000088bc1133 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788969826.972150:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000091e5ff11) 00000020:00000080:1.0:1788969826.972156:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788969826.972204:0:5855:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788969826.972209:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b3834 00000020:00000080:1.0:1788969826.972315:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788969826.972322:0:5855:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788969826.972327:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d0de860b05b383b 00080000:01000000:1.0:1788969826.972331:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788969826.972334:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b3842 00080000:10000000:1.0:1788969826.972718:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788969826.973229:0:5855:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788969826.978386:0:5855:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788969827.112727:0:5855:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788969827.113303:0:5855:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788969827.118593:0:5855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788969827.119719:0:5855:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788969827.190760:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f859dd46) 00000020:00000080:2.0:1788969827.190784:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788969827.190894:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788969827.190903:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b3850 00000020:00000080:1.0:1788969827.193277:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788969827.194766:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788969827.348325:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788969827.388190:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:1.0:1788969827.397885:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788969827.425088:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788969827.480481:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788969827.546941:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788969827.633184:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d0de860b05b3857 00000020:00000080:2.0:1788969827.634304:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788969827.634317:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788969827.634325:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969827.634327:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788969827.634331:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788969827.634335:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969827.634336:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788969827.634340:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788969827.634341:0:5855:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788969827.634344:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788969827.634347:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969827.634348:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788969827.634350:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788969827.634355:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969827.634357:0:5855:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788969827.634361:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788969827.634401:0:5855:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788969827.634457:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067c206c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:5855:1875870741431552:0@lo:502: 00000100:00100000:2.0:1788969827.634676:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969827.634787:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089f23f72 going to sleep for 11 seconds 00000100:00100000:1.0:1788969827.634880:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741431552 00000100:00100000:1.0:1788969827.634888:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741431552 00000100:00100000:1.0:1788969827.634927:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788969827.634935:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000763923d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:5855:x1875870741431552:12345-0@lo:502: 00000100:00100000:1.0:1788969827.635268:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000763923d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:5855:x1875870741431552:12345-0@lo:502: Request processed in 333us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969827.635276:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788969827.635556:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067c206c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:5855:1875870741431552:0@lo:502: 00000020:01000000:2.0:1788969827.635600:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788969827.635606:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969827.635608:0:5855:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788969827.635612:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788969827.635899:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788969827.635920:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788969827.635939:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 00000000bdeff810/0x5d0de860b05b380a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.635950:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 00000000bdeff810/0x5d0de860b05b380a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969827.635958:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97786f03a800 from 1 10000000:01000000:1.0:1788969827.635961:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788969827.635987:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.635995:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.636002:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969827.636030:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431680:0@lo:101: 00000100:00100000:1.0:1788969827.636066:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969827.636158:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741431680 00000100:00100000:2.0:1788969827.636164:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741431680 00000100:00100000:2.0:1788969827.636190:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788969827.636196:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004446e581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:5813:x1875870741431680:12345-0@lo:101: 00010000:00010000:2.0:1788969827.636205:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969827.636218:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b385e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969827.636238:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b385e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969827.636247:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b385e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969827.636255:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b85e43c5, rc 0) 00000100:00100000:2.0:1788969827.636281:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004446e581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+10:5813:x1875870741431680:12345-0@lo:101: Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969827.636286:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788969827.636711:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a503d4e7 going to sleep for 11 seconds 00000100:00100000:1.0:1788969827.636728:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431680:0@lo:101: 00010000:00010000:1.0:1788969827.636741:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.636750:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969827.637776:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067c206c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431808:0@lo:256: 00000100:00100000:2.0:1788969827.637914:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969827.638001:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f576db9 going to sleep for 11 seconds 00000100:00100000:0.0:1788969827.638214:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741431808 00000100:00100000:0.0:1788969827.638222:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741431808 00000100:00100000:0.0:1788969827.638298:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788969827.638305:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000adf149a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+10:5813:x1875870741431808:12345-0@lo:256: 20000000:01000000:0.0:1788969827.638323:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788969827.638328:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788969827.638685:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000adf149a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+10:5813:x1875870741431808:12345-0@lo:256: Request processed in 380us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969827.638694:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788969827.638767:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067c206c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431808:0@lo:256: 10000000:01000000:3.0:1788969827.639766:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788969827.641108:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.641137:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969827.641147:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97786f03a800 from 1 10000000:01000000:3.0:1788969827.641150:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788969827.641184:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.641191:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.641200:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969827.641221:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431936:0@lo:101: 00000100:00100000:3.0:1788969827.642179:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969827.645609:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099f6de9a going to sleep for 11 seconds 00000100:00100000:3.0:1788969827.653022:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741431936 00000100:00100000:3.0:1788969827.653040:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741431936 00000100:00100000:3.0:1788969827.653105:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788969827.653115:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e8c2d79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+10:5813:x1875870741431936:12345-0@lo:101: 00010000:00010000:3.0:1788969827.653133:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969827.653155:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b386c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.653182:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b386c expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.653195:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b386c expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.653217:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000e17f589, rc 0) 00000100:00100000:3.0:1788969827.653824:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e8c2d79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:5813:x1875870741431936:12345-0@lo:101: Request processed in 709us (11645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969827.653831:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788969827.659739:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099b64b83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741431936:0@lo:101: 00010000:00010000:0.0:1788969827.659771:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.659823:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969827.662722:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432064:0@lo:501: 00000100:00100000:1.0:1788969827.662818:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969827.662866:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a503d4e7 going to sleep for 11 seconds 00000100:00100000:0.0:1788969827.662981:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741432064 00000100:00100000:0.0:1788969827.662989:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741432064 00000100:00100000:0.0:1788969827.663052:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788969827.663061:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000abc72dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:5813:x1875870741432064:12345-0@lo:501: 00000100:00100000:0.0:1788969827.664300:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000abc72dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:5813:x1875870741432064:12345-0@lo:501: Request processed in 1236us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969827.664313:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788969827.664499:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432064:0@lo:501: 00000100:00100000:1.0:1788969827.664547:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432192:0@lo:503: 00000100:00100000:1.0:1788969827.664661:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969827.664699:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a503d4e7 going to sleep for 11 seconds 00000100:00100000:3.0:1788969827.664778:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741432192 00000100:00100000:3.0:1788969827.664784:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741432192 00000100:00100000:3.0:1788969827.664848:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788969827.664855:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c978831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:5813:x1875870741432192:12345-0@lo:503: 00000040:00080000:3.0:1788969827.664897:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788969827.664946:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c978831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:5813:x1875870741432192:12345-0@lo:503: Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969827.664952:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788969827.665148:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432192:0@lo:503: 00000040:00080000:3.0:1788969827.666202:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788969827.669525:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788969827.669563:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788969827.669681:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.669695:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969827.669766:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788969827.669769:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97786f03a800 10000000:01000000:1.0:1788969827.669773:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97786f03a800 10000000:01000000:1.0:1788969827.669776:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788969827.669827:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97786f03a800 from 1 10000000:01000000:1.0:1788969827.669830:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788969827.669863:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 0000000026410b21/0x5d0de860b05b387a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.669872:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 0000000026410b21/0x5d0de860b05b387a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.669881:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 0000000026410b21/0x5d0de860b05b387a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969827.669901:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432320:0@lo:101: 00000100:00100000:1.0:1788969827.669960:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969827.670000:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000469ce867 going to sleep for 11 seconds 00000100:00100000:0.0:1788969827.670199:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741432320 00000100:00100000:0.0:1788969827.670207:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741432320 00000100:00100000:0.0:1788969827.670253:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788969827.670260:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4a1070 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:5813:x1875870741432320:12345-0@lo:101: 00010000:00010000:0.0:1788969827.670272:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969827.670284:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c43081b7/0x5d0de860b05b3881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b387a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.670305:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c43081b7/0x5d0de860b05b3881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b387a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.670313:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c43081b7/0x5d0de860b05b3881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b387a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.670320:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c43081b7, rc 0) 00000100:00100000:0.0:1788969827.670353:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4a1070 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5813:x1875870741432320:12345-0@lo:101: Request processed in 94us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969827.670369:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788969827.670490:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432320:0@lo:101: 00010000:00010000:1.0:1788969827.670502:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 0000000026410b21/0x5d0de860b05b387a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.670509:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 0000000026410b21/0x5d0de860b05b387a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969827.670555:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432448:0@lo:501: 00000100:00100000:1.0:1788969827.670591:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969827.670613:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000469ce867 going to sleep for 11 seconds 00000100:00100000:3.0:1788969827.670720:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741432448 00000100:00100000:3.0:1788969827.670725:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741432448 00000100:00100000:3.0:1788969827.670757:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788969827.670763:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089ed4f6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5813:x1875870741432448:12345-0@lo:501: 00000100:00100000:3.0:1788969827.671046:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089ed4f6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5813:x1875870741432448:12345-0@lo:501: Request processed in 283us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969827.671054:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788969827.671247:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432448:0@lo:501: 00000100:00100000:1.0:1788969827.671276:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432576:0@lo:503: 00000100:00100000:1.0:1788969827.671313:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969827.671481:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000469ce867 going to sleep for 11 seconds 00000100:00100000:3.0:1788969827.672598:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741432576 00000100:00100000:3.0:1788969827.672608:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741432576 00000100:00100000:3.0:1788969827.672655:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788969827.672662:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089d79cad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5813:x1875870741432576:12345-0@lo:503: 00000100:00100000:3.0:1788969827.673156:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089d79cad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5813:x1875870741432576:12345-0@lo:503: Request processed in 494us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969827.673173:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788969827.673558:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741432576:0@lo:503: 00000100:00100000:1.0:1788969827.674283:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:5860:1875870741432704:0@lo:502: 00000100:00100000:1.0:1788969827.674341:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969827.674424:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069fabe41 going to sleep for 11 seconds 00000100:00100000:0.0:1788969827.674780:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741432704 00000100:00100000:0.0:1788969827.674945:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741432704 00000100:00100000:1.0:1788969827.675402:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788969827.675411:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000006dae90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5860:x1875870741432704:12345-0@lo:502: 00000100:00100000:1.0:1788969827.676233:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000006dae90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5860:x1875870741432704:12345-0@lo:502: Request processed in 821us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969827.676243:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788969827.676317:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064a0c11e pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:5860:1875870741432704:0@lo:502: 00000020:01000004:0.0:1788969827.676384:0:5860:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788969827.676398:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000931ae940) 00000020:00000080:0.0:1788969827.676415:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788969827.676498:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000088bc1133 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788969827.676503:0:5860:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000088bc1133 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788969827.676505:0:5860:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000088bc1133 4 00010000:00080000:0.0:1788969827.676530:0:5860:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004fbccaee@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:2.0:1788969827.683223:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788969827.683431:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788969827.683469:0:5860:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788969827.683481:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d0de860b05b388f 00000100:00080000:2.0:1788969827.683491:0:5860:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788969827.683502:0:5860:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004fbccaee using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788969827.683537:0:5860:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008e13b94b x1875870741432832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788969827.683615:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e13b94b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741432832:0@lo:38: 00000100:00100000:1.0:1788969827.683684:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969827.685382:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741432832 00000100:00100000:0.0:1788969827.685394:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741432832 00000100:00100000:0.0:1788969827.685432:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788969827.685438:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb4e43a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875870741432832:12345-0@lo:38: 00000100:00080000:2.0:1788969827.685545:0:5860:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788969827.690378:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb4e43a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875870741432832:12345-0@lo:38: Request processed in 4930us (6685us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788969827.690395:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788969827.692215:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c361d1d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:5860:1875870741432960:0@lo:502: 00000100:00100000:0.0:1788969827.692296:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969827.692334:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741432960 00000100:00100000:0.0:1788969827.692341:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741432960 00000100:00100000:0.0:1788969827.692379:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788969827.692387:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c41a79b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5860:x1875870741432960:12345-0@lo:502: 00000100:00100000:0.0:1788969827.692589:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c41a79b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5860:x1875870741432960:12345-0@lo:502: Request processed in 203us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969827.692597:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788969827.692657:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 000000006caa79ee going to sleep for 11 seconds 00000100:00100000:0.0:1788969827.692676:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c361d1d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:5860:1875870741432960:0@lo:502: 00000040:00080000:0.0:1788969827.692701:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788969827.692986:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788969827.693005:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788969827.693039:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 0000000026410b21/0x5d0de860b05b387a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969827.693051:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 0000000026410b21/0x5d0de860b05b387a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788969827.693097:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788969827.693100:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788969827.693101:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788969827.693103:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788969827.693104:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788969827.693105:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788969827.693106:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788969827.693108:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788969827.693109:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788969827.693110:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788969827.693112:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788969827.693113:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788969827.693117:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788969827.693119:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788969827.693121:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788969827.693122:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788969827.693123:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788969827.693124:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788969827.693125:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788969827.693126:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788969827.693126:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788969827.693127:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788969827.693128:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788969827.693129:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788969827.693130:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788969827.693146:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788969827.693161:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4ce48a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741433088:0@lo:253: 00000100:00100000:2.0:1788969827.693198:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969827.693222:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b924446 going to sleep for 11 seconds 00000100:00100000:1.0:1788969827.694683:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788969827.694694:0:3282:0:(import.c:65:import_set_state_nolock()) 000000004fbccaee lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788969827.694700:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788969827.694703:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e13b94b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741432832:0@lo:38: 00000100:00100000:1.0:1788969827.694739:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741433088 00000100:00100000:1.0:1788969827.694745:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741433088 00000100:00100000:1.0:1788969827.694816:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788969827.694824:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c9073a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5813:x1875870741433088:12345-0@lo:253: 20000000:01000000:1.0:1788969827.694847:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788969827.694859:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788969827.730418:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788969827.730442:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788969827.730666:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788969827.730672:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788969827.730691:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.730709:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b385e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.730716:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.730750:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b385e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.730765:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b385e expref: 12 pid: 5827 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969827.730779:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbc310a2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875870741433216:0@lo:104: 00000100:00100000:3.0:1788969827.730866:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969827.730992:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb60ac82 going to sleep for 11 seconds 00000100:00100000:1.0:1788969827.731222:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741433216 00000100:00100000:1.0:1788969827.731231:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741433216 00000100:00100000:1.0:1788969827.731280:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788969827.731288:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002446e491 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5848:x1875870741433216:12345-0@lo:104: 00010000:00010000:1.0:1788969827.731314:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.731374:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788969827.731380:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002446e491 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5848:x1875870741433216:12345-0@lo:104: Request processed in 93us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969827.731387:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788969827.731406:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788969827.731410:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.731417:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000085ca2908 already unused, calling callback (00000000605cdffc) 10000000:00010000:1.0:1788969827.731420:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.731428:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788969827.731433:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969827.731439:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788969827.731463:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.731469:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788969827.731482:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.731489:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b385e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3865 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969827.731603:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969827.731606:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969827.731607:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969827.731663:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039718e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741433344:0@lo:103: 00000100:00100000:1.0:1788969827.731691:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969827.731785:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741433344 00000100:00100000:0.0:1788969827.731818:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741433344 00010000:00010000:0.0:1788969827.731836:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b385e expref: 13 pid: 5827 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969827.731855:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788969827.731861:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000002794a7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:3284:x1875870741433344:12345-0@lo:103: 00010000:00010000:0.0:1788969827.731871:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969827.731875:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b385e expref: 13 pid: 5827 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731884:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b385e expref: 13 pid: 5827 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731899:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731919:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788969827.731933:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001262388s 00010000:00010000:0.0:1788969827.731937:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731943:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731949:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731961:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731967:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e0996d11 already unused, calling callback (000000008f3987d0) 00010000:00010000:0.0:1788969827.731970:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731977:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731985:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969827.731994:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969827.732233:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000002794a7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:3284:x1875870741433344:12345-0@lo:103: Request processed in 373us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969827.732241:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788969827.732332:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039718e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741433344:0@lo:103: 00010000:00010000:3.0:1788969827.732396:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b85e43c5/0x5d0de860b05b3865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b385e expref: 12 pid: 5827 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969827.732407:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbc310a2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875870741433216:0@lo:104: 00010000:00010000:3.0:1788969827.732422:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.732429:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.732445:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969827.732450:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e0996d11/0x5d0de860b05b3896 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969827.744639:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c9073a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:5813:x1875870741433088:12345-0@lo:253: Request processed in 49809us (51434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969827.744655:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788969827.744887:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4ce48a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:5813:1875870741433088:0@lo:253: 10000000:01000000:3.0:1788969827.744902:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788969827.744981:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788969827.744983:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788969827.744984:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788969827.744985:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788969827.744986:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788969827.744988:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788969827.744989:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788969827.744990:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788969827.744991:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788969827.744993:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788969827.744994:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788969827.744996:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788969827.745113:0:5813:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788969827.751272:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788969827.751654:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788969827.752388:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788969827.752567:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788969827.753271:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788969827.753451:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788969827.754589:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788969827.754892:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788969827.755178:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788969827.755412:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788969827.755680:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788969827.756038:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788969827.831941:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788969827.963253:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788969827.963423:0:5865:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788969827.963428:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788969827.963716:0:5866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788969827.978208:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788969827.979204:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788969827.980618:0:5813:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788969827.980631:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788969827.980865:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788969827.983521:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788969827.984321:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788969827.984684:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788969827.984998:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788969827.985316:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788969827.991900:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788969827.993820:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788969827.997221:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788969828.002236:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788969828.002468:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788969828.005490:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788969828.006261:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788969828.008462:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788969828.012142:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788969828.012353:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788969828.012525:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788969828.014299:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788969828.015218:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788969828.015375:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788969828.015539:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788969828.017323:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788969828.020913:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788969828.021117:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788969828.021301:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788969828.021495:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788969828.021644:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788969828.021829:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788969828.021982:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788969828.022131:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788969828.022283:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788969828.022414:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788969828.022555:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788969828.022690:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788969828.022874:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788969828.023035:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788969828.023190:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788969828.023326:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788969828.023544:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788969828.051542:0:5866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788969828.143729:0:5813:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788969828.143770:0:5813:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc26c18bb988 00100000:10000000:0.0:1788969828.143778:0:5813:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788969828.144441:0:5813:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788969828.144458:0:5813:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788969828.144471:0:5813:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788969828.144496:0:5813:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788969828.211897:0:5866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788969828.211964:0:5866:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1788969828.211969:0:5866:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788969828.437131:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969829.445076:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969830.472839:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969831.499162:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788969832.420204:0:6109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788969832.517455:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788969832.900950:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788969832.900966:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97786f03a800 from 3 10000000:01000000:1.0:1788969832.900971:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788969832.901016:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 00000000a5328720/0x5d0de860b05b389d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969832.901029:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 00000000a5328720/0x5d0de860b05b389d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969832.901039:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 00000000a5328720/0x5d0de860b05b389d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969832.901063:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bca9f81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741433472:0@lo:101: 00000100:00100000:1.0:1788969832.901131:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969832.901193:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000502b3cb6 going to sleep for 11 seconds 00000100:00100000:3.0:1788969832.901279:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741433472 00000100:00100000:3.0:1788969832.901288:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741433472 00000100:00100000:3.0:1788969832.901337:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788969832.901345:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b62f6401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:5829:x1875870741433472:12345-0@lo:101: 00010000:00010000:3.0:1788969832.901358:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969832.901371:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a5babe57/0x5d0de860b05b38a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b389d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969832.901393:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5babe57/0x5d0de860b05b38a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b389d expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969832.901403:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a5babe57/0x5d0de860b05b38a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b389d expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969832.901412:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a5babe57, rc 0) 00000100:00100000:3.0:1788969832.901458:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b62f6401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741433472:12345-0@lo:101: Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969832.901474:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788969832.901830:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bca9f81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741433472:0@lo:101: 00010000:00010000:1.0:1788969832.901844:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 00000000a5328720/0x5d0de860b05b389d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969832.901867:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 00000000a5328720/0x5d0de860b05b389d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969832.901914:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bca9f81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741433600:0@lo:256: 00000100:00100000:1.0:1788969832.901948:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969832.902003:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000502b3cb6 going to sleep for 11 seconds 00000100:00100000:2.0:1788969832.902232:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741433600 00000100:00100000:2.0:1788969832.902238:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741433600 00000100:00100000:2.0:1788969832.902273:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788969832.902279:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000644a5acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741433600:12345-0@lo:256: 20000000:01000000:2.0:1788969832.902293:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788969832.902307:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788969832.902310:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788969832.902391:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000644a5acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741433600:12345-0@lo:256: Request processed in 112us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969832.902398:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788969832.902584:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bca9f81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741433600:0@lo:256: 10000000:01000000:1.0:1788969832.902622:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788969832.902628:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: 00000000a5328720/0x5d0de860b05b389d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969832.902637:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: 00000000a5328720/0x5d0de860b05b389d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788969832.913657:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788969832.913666:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788969832.913669:0:38:0:(import.c:65:import_set_state_nolock()) 000000004fbccaee lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788969832.913688:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004fbccaee using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1788969832.913722:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bca9f81a x1875870741433728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788969832.913842:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bca9f81a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741433728:0@lo:38: 00000100:00100000:2.0:1788969832.913909:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969832.914232:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741433728 00000100:00100000:1.0:1788969832.914240:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741433728 00000100:00100000:1.0:1788969832.914278:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788969832.914283:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000720470e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875870741433728:12345-0@lo:38: 00010000:00080000:1.0:1788969832.914305:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:1.0:1788969832.914350:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d0de860b05b38ab 00000004:00100000:1.0:1788969832.914389:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788969832.914499:0:5834:0:(import.c:65:import_set_state_nolock()) 0000000067d33536 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788969832.915658:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000720470e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875870741433728:12345-0@lo:38: Request processed in 1370us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969832.915670:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788969832.918285:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bca9f81a x1875870741433728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788969842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788969832.918326:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788969832.918334:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788969832.918341:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788969832.918344:0:3282:0:(import.c:65:import_set_state_nolock()) 000000004fbccaee lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788969832.918351:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bca9f81a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741433728:0@lo:38: 00010000:00010000:0.0:1788969833.550044:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969834.566217:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969835.589266:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969836.633160:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969837.641081:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969838.025858:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002906af28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741433856:0@lo:400: 00000100:00100000:3.0:1788969838.025970:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969838.026090:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741433856 00000100:00100000:0.0:1788969838.026099:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741433856 00000100:00100000:0.0:1788969838.026156:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788969838.026165:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069945ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3285:x1875870741433856:12345-0@lo:400: 00000100:00100000:0.0:1788969838.030115:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069945ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3285:x1875870741433856:12345-0@lo:400: Request processed in 3943us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969838.030133:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788969838.030360:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2532028 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741433984:0@lo:400: 00000100:00100000:0.0:1788969838.030428:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969838.030487:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741433984 00000100:00100000:0.0:1788969838.030496:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741433984 00000100:00100000:0.0:1788969838.030533:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788969838.030539:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000106b463d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741433984:12345-0@lo:400: 00000100:00100000:0.0:1788969838.030584:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000106b463d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741433984:12345-0@lo:400: Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969838.030882:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788969838.030932:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c2532028 x1875870741433984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969838.030946:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2532028 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741433984:0@lo:400: 00000100:00100000:3.0:1788969838.031523:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002906af28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741433856:0@lo:400: 00010000:00010000:3.0:1788969838.662001:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788969838.791073:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9aad0690 20000000:00000080:3.0:1788969838.791089:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9778652efc00 uarg=0000000000000000 20000000:01000000:3.0:1788969838.791186:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788969838.791193:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788969838.791198:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788969838.791526:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788969838.791539:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788969838.802679:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788969838.805247:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788969838.805338:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788969838.806696:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788969838.806729:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788969838.806752:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969838.806771:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b386c expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969838.806779:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969838.807104:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b386c expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969838.807121:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b386c expref: 11 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969838.807135:0:6311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bcf0f668 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875870741434112:0@lo:104: 00000100:00100000:2.0:1788969838.807220:0:6311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969838.807400:0:6311:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069bc6aef going to sleep for 11 seconds 00000100:00100000:0.0:1788969838.809652:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741434112 00000100:00100000:0.0:1788969838.809667:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741434112 00000100:00100000:0.0:1788969838.809765:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788969838.809774:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c440596 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:6311:x1875870741434112:12345-0@lo:104: 00010000:00010000:0.0:1788969838.809814:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969838.810078:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788969838.810083:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c440596 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:6311:x1875870741434112:12345-0@lo:104: Request processed in 311us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969838.810091:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788969838.810189:0:6311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bcf0f668 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875870741434112:0@lo:104: 00010000:00010000:3.0:1788969838.810216:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.810640:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788969838.810646:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.810654:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002850e234 already unused, calling callback (00000000605cdffc) 10000000:00010000:1.0:1788969838.810658:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.810666:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788969838.810673:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969838.810679:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788969838.810723:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.810730:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788969838.810756:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.810762:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: 000000002850e234/0x5d0de860b05b386c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3873 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.810822:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969838.810824:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969838.810825:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969838.810833:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788969838.810856:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ea3ac1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741434240:0@lo:103: 00000100:00100000:1.0:1788969838.810915:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969838.810961:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741434240 00000100:00100000:1.0:1788969838.810966:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741434240 00010000:00010000:1.0:1788969838.810987:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b386c expref: 12 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969838.811010:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788969838.811016:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3aa4282 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3284:x1875870741434240:12345-0@lo:103: 00010000:00010000:1.0:1788969838.811026:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969838.811030:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b386c expref: 12 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811039:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b386c expref: 12 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811052:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e17f589/0x5d0de860b05b3873 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b386c expref: 12 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811063:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811069:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811106:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811112:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811117:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811123:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811127:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030f76017 already unused, calling callback (000000008f3987d0) 00010000:00010000:1.0:1788969838.811130:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811135:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811146:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969838.811168:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969838.811205:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3aa4282 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:3284:x1875870741434240:12345-0@lo:103: Request processed in 189us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969838.811212:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788969838.811243:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ea3ac1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741434240:0@lo:103: 00010000:00010000:3.0:1788969838.813890:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969838.813921:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969838.813928:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030f76017/0x5d0de860b05b38b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969839.685050:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969840.713739:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788969840.718059:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788969840.718068:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97786f03a800 from 1 10000000:01000000:1.0:1788969840.718074:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788969840.718127:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b38b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969840.718141:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b38b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969840.718151:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b38b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969840.718174:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c600976 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741434368:0@lo:101: 00000100:00100000:1.0:1788969840.718246:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969840.718402:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000008af48d3e going to sleep for 11 seconds 00000100:00100000:0.0:1788969840.726707:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741434368 00000100:00100000:0.0:1788969840.726721:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741434368 00000100:00100000:0.0:1788969840.727500:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788969840.727512:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bdef48a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:5829:x1875870741434368:12345-0@lo:101: 00010000:00010000:0.0:1788969840.727531:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969840.727552:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac6b7af4/0x5d0de860b05b38c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b38b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969840.727593:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac6b7af4/0x5d0de860b05b38c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b38b9 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969840.727618:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac6b7af4/0x5d0de860b05b38c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b38b9 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969840.727626:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac6b7af4, rc 0) 00000100:00100000:0.0:1788969840.727708:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bdef48a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741434368:12345-0@lo:101: Request processed in 198us (9462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969840.727714:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788969840.727929:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c600976 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741434368:0@lo:101: 00010000:00010000:1.0:1788969840.727947:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b38b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969840.727956:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: 0000000085ca2908/0x5d0de860b05b38b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969840.728024:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c600976 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741434496:0@lo:501: 00000100:00100000:1.0:1788969840.728057:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969840.733901:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000008af48d3e going to sleep for 11 seconds 00000100:00100000:2.0:1788969840.735719:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741434496 00000100:00100000:2.0:1788969840.735742:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741434496 00000100:00100000:3.0:1788969840.736759:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788969840.736770:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b6f2cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741434496:12345-0@lo:501: 00000100:00100000:3.0:1788969840.737129:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b6f2cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741434496:12345-0@lo:501: Request processed in 360us (9071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969840.737138:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788969840.737953:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c600976 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741434496:0@lo:501: 00000100:00100000:2.0:1788969840.738014:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c21163d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741434624:0@lo:503: 00000100:00100000:2.0:1788969840.738063:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969840.738092:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 0000000093036e34 going to sleep for 11 seconds 00000100:00100000:2.0:1788969840.738106:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741434624 00000100:00100000:2.0:1788969840.738112:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741434624 00000100:00100000:2.0:1788969840.738139:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788969840.738145:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008cea3dee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741434624:12345-0@lo:503: 00000100:00100000:2.0:1788969840.738271:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008cea3dee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741434624:12345-0@lo:503: Request processed in 126us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969840.738278:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788969840.738317:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c21163d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741434624:0@lo:503: 00000100:00100000:3.0:1788969840.741144:0:6349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000299ef5e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:6349:1875870741434752:0@lo:502: 00000100:00100000:3.0:1788969840.741222:0:6349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969840.741263:0:6349:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9a16442 going to sleep for 11 seconds 00000100:00100000:2.0:1788969840.741475:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741434752 00000100:00100000:2.0:1788969840.741482:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741434752 00000100:00100000:2.0:1788969840.741528:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788969840.741536:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab9ac7b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6349:x1875870741434752:12345-0@lo:502: 00000100:00100000:2.0:1788969840.741864:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab9ac7b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6349:x1875870741434752:12345-0@lo:502: Request processed in 328us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969840.741872:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788969840.755915:0:6349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000299ef5e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:6349:1875870741434752:0@lo:502: 00000020:01000000:0.0:1788969840.755973:0:6349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788969840.755986:0:6349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788969840.755989:0:6349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788969840.755996:0:6349:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97786f03a800 00000020:00000080:0.0:1788969840.755999:0:6349:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788969840.756055:0:6349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:6349:1875870741434880:0@lo:502: 00000100:00100000:0.0:1788969840.756126:0:6349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969840.756177:0:6349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778455020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969840.756324:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741434880 00000100:00100000:3.0:1788969840.756331:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741434880 00000100:00100000:3.0:1788969840.756397:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788969840.756406:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6349:x1875870741434880:12345-0@lo:502: 00000100:00100000:3.0:1788969840.756608:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6349:x1875870741434880:12345-0@lo:502: Request processed in 203us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969840.756617:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788969840.757108:0:6349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:6349:1875870741434880:0@lo:502: 00000020:01000000:0.0:1788969840.757133:0:6349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788969840.757140:0:6349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788969840.757142:0:6349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788969840.757146:0:6349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788969840.762980:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788969840.763016:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788969840.763027:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969840.763040:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969841.743945:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969842.769684:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969843.142750:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741435136:0@lo:400: 00000100:00100000:3.0:1788969843.142845:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969843.142941:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741435136 00000100:00100000:3.0:1788969843.142950:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741435136 00000100:00100000:3.0:1788969843.142994:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788969843.143003:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741435136:12345-0@lo:400: 00000100:00100000:3.0:1788969843.143054:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741435136:12345-0@lo:400: Request processed in 52us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969843.143061:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788969843.143098:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff977855cebc00 x1875870741435136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969843.143126:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741435136:0@lo:400: 00000100:00100000:1.0:1788969843.143213:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741435008:0@lo:400: 00000100:00100000:1.0:1788969843.143250:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969843.143455:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741435008 00000100:00100000:3.0:1788969843.143459:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741435008 00000100:00100000:3.0:1788969843.143485:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788969843.143492:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3284:x1875870741435008:12345-0@lo:400: 00000100:00100000:3.0:1788969843.143695:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3284:x1875870741435008:12345-0@lo:400: Request processed in 203us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969843.143703:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788969843.166476:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741435008:0@lo:400: 00010000:00010000:0.0:1788969843.782944:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969844.817014:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969845.828979:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969846.856308:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788969847.049442:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788969847.049445:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788969847.049541:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9778601fa800 00000020:01000004:3.0:1788969847.049554:0:6674:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788969847.049563:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788969847.049573:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9778650e99c0) 00000020:00000080:3.0:1788969847.049585:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788969847.059815:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788969847.060092:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788969847.078920:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788969847.082966:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788969847.083004:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788969847.083065:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788969847.083094:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788969847.083444:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788969847.083454:0:6674:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788969847.083465:0:6674:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d0de860b05b38ce 00000020:01000004:2.0:1788969847.083473:0:6674:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788969847.083492:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788969847.083496:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788969847.083501:0:6674:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788969847.083506:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788969847.083518:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9778652fcd40) 00000020:00000080:2.0:1788969847.083528:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788969847.084676:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788969847.084972:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788969847.084979:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788969847.087546:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788969847.087558:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788969847.089969:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788969847.089980:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788969847.091695:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788969847.092434:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788969847.092442:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788969847.093066:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788969847.093074:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788969847.118252:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788969847.118488:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788969847.118496:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788969847.119582:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788969847.119591:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788969847.121074:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788969847.121088:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788969847.123084:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788969847.123268:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788969847.123274:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788969847.124127:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788969847.124134:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788969847.165734:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788969847.166118:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788969847.166125:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788969847.167125:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788969847.167137:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788969847.167537:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788969847.167675:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788969847.167682:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788969847.183487:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788969847.183526:0:6674:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788969847.183531:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788969847.183533:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788969847.183534:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788969847.183535:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788969847.183536:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788969847.183537:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788969847.183538:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788969847.183540:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788969847.183541:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788969847.183542:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788969847.183544:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788969847.183548:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788969847.183550:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788969847.183552:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788969847.183553:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788969847.183554:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788969847.183555:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788969847.183556:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788969847.183557:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788969847.183558:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788969847.183559:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788969847.183560:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788969847.183561:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788969847.183592:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788969847.183608:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741435264:0@lo:253: 00000100:00100000:0.0:1788969847.183677:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.183863:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778434066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.183949:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741435264 00000100:00100000:2.0:1788969847.183957:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741435264 00000100:00100000:2.0:1788969847.184062:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788969847.184071:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741435264:12345-0@lo:253: 20000000:01000000:2.0:1788969847.184097:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788969847.184100:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788969847.184105:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788969847.184108:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788969847.185172:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788969847.185469:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788969847.185482:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788969847.185521:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788969847.185529:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788969847.185559:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788969847.185620:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788969847.186088:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788969847.186110:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.109@tcp 20000000:01000000:2.0:1788969847.186112:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:2.0:1788969847.186150:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788969847.186158:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788969847.186219:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788969847.186227:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:2.0:1788969847.186260:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788969847.186269:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788969847.186298:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788969847.186442:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788969847.187159:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788969847.187184:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.109@tcp 20000000:01000000:2.0:1788969847.187186:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:2.0:1788969847.187217:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788969847.187223:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788969847.187247:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788969847.187253:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:2.0:1788969847.187289:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788969847.187296:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788969847.187321:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788969847.187428:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788969847.187444:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788969847.187447:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788969847.187451:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788969847.187463:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788969847.187466:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788969847.187497:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788969847.187499:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788969847.188137:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788969847.188185:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788969847.188251:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788969847.188578:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788969847.188612:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788969847.188656:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788969847.188668:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788969847.188670:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788969847.189165:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788969847.189212:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788969847.189262:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788969847.189542:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788969847.189579:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788969847.189607:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788969847.189618:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788969847.189619:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788969847.190015:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788969847.190210:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788969847.190248:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788969847.190308:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788969847.190322:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788969847.190324:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788969847.190400:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788969847.190424:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.190441:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778414a9600/0x5d0de860b05b37f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b37ee expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.190449:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b380a expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.190455:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b387a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.190462:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.190500:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b387a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.190517:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3881 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b387a expref: 12 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969847.190531:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d52c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741435392:0@lo:104: 00000100:00100000:2.0:1788969847.190588:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788969847.190684:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b380a expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.190693:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3811 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b380a expref: 12 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969847.190702:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741435520:0@lo:104: 00000100:00100000:2.0:1788969847.190722:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788969847.190836:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778414a9600/0x5d0de860b05b37f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b37ee expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.190845:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778414a9600/0x5d0de860b05b37f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b37ee expref: 12 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969847.190853:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d4f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741435648:0@lo:104: 00000100:00100000:2.0:1788969847.190874:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.190959:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741435392 00000100:00100000:0.0:1788969847.190966:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741435392 00000100:00100000:0.0:1788969847.190999:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741435520 00000100:00100000:0.0:1788969847.191002:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741435520 00000100:00100000:0.0:1788969847.191013:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788969847.191021:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:5826:x1875870741435392:12345-0@lo:104: 00010000:00010000:0.0:1788969847.191033:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b387a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191086:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788969847.191091:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:5826:x1875870741435392:12345-0@lo:104: Request processed in 71us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.191097:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788969847.191114:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788969847.191119:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5826:x1875870741435520:12345-0@lo:104: 00010000:00010000:0.0:1788969847.191126:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b380a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191156:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788969847.191161:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5826:x1875870741435520:12345-0@lo:104: Request processed in 42us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.191167:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788969847.191183:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788969847.191188:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b387a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191195:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8200 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788969847.191199:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b387a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191208:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b387a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788969847.191215:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b387a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969847.191220:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788969847.191253:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b387a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191260:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788969847.191276:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b387a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191284:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b387a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3881 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191298:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788969847.191690:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969847.191724:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b380a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191730:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788969847.191733:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b380a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191739:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b380a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788969847.191744:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b380a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969847.191749:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788969847.191764:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b380a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191770:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788969847.191818:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741435904:0@lo:103: 00000100:00100000:3.0:1788969847.191859:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788969847.191933:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b380a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191951:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b380a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3811 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.191961:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969847.191963:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969847.191964:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969847.191983:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741435776:0@lo:103: 00000100:00100000:0.0:1788969847.192008:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.192124:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741435904 00000100:00100000:0.0:1788969847.192130:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741435904 00010000:00010000:0.0:1788969847.192147:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3811 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b380a expref: 13 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.192167:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741435776 00000100:00100000:0.0:1788969847.192170:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741435776 00010000:00010000:0.0:1788969847.192181:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3881 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b387a expref: 14 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.192191:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788969847.192197:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3283:x1875870741435904:12345-0@lo:103: 00010000:00010000:0.0:1788969847.192207:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969847.192210:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3811 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b380a expref: 14 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.192219:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3811 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b380a expref: 14 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.192233:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969847.192360:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741435648 00000100:00100000:2.0:1788969847.192364:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741435648 00000100:00100000:2.0:1788969847.192382:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788969847.192389:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5826:x1875870741435648:12345-0@lo:104: 00010000:00010000:2.0:1788969847.192399:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841544e00/0x5d0de860b05b37ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.192431:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788969847.192436:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5826:x1875870741435648:12345-0@lo:104: Request processed in 49us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.192442:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788969847.192458:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788969847.192462:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841544e00/0x5d0de860b05b37ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.192469:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841544e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788969847.192472:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841544e00/0x5d0de860b05b37ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.192480:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841544e00/0x5d0de860b05b37ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788969847.192497:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841544e00/0x5d0de860b05b37ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788969847.192502:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788969847.192521:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841544e00/0x5d0de860b05b37ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.192526:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788969847.192581:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3283:x1875870741435904:12345-0@lo:103: Request processed in 384us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.192588:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788969847.192600:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788969847.192605:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:3286:x1875870741435776:12345-0@lo:103: 00010000:00010000:0.0:1788969847.192612:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969847.192616:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3881 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b387a expref: 13 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.192625:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3881 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b387a expref: 13 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.192633:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969847.192658:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:3286:x1875870741435776:12345-0@lo:103: Request processed in 53us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.192663:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788969847.192696:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741435776:0@lo:103: 00010000:00010000:2.0:1788969847.192818:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841544e00/0x5d0de860b05b37ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.192835:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841544e00/0x5d0de860b05b37ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b37f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.192855:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969847.192857:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969847.192858:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969847.192868:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741436032:0@lo:103: 00000100:00100000:2.0:1788969847.192893:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969847.192928:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878e7ac00 going to sleep for 11 seconds 00010000:00010000:2.0:1788969847.192942:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b387a expref: 12 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969847.192953:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d52c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741435392:0@lo:104: 00010000:00010000:2.0:1788969847.192963:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b380a expref: 11 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969847.192972:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741435520:0@lo:104: 00000100:00100000:2.0:1788969847.192993:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d4f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741435648:0@lo:104: 00010000:00010000:2.0:1788969847.193014:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.193075:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741436032 00000100:00100000:0.0:1788969847.193080:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741436032 00010000:00010000:0.0:1788969847.193095:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778414a9600/0x5d0de860b05b37f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b37ee expref: 11 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.193120:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788969847.193125:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:3284:x1875870741436032:12345-0@lo:103: 00010000:00010000:0.0:1788969847.193132:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969847.193136:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778414a9600/0x5d0de860b05b37f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b37ee expref: 11 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193144:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778414a9600/0x5d0de860b05b37f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b37ee expref: 11 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193160:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9600/0x5d0de860b05b37f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b37ee expref: 11 pid: 5826 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193172:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193180:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193193:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193199:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193207:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193213:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193219:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788969847.193223:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193231:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193243:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.193262:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969847.193289:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+10:3284:x1875870741436032:12345-0@lo:103: Request processed in 163us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.193294:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788969847.193362:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741436032:0@lo:103: 00010000:00010000:2.0:1788969847.193377:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.193383:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.193389:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788969847.193401:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788969847.194132:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741435904:0@lo:103: 00000100:00100000:2.0:1788969847.225270:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:6674:x1875870741435264:12345-0@lo:253: Request processed in 41190us (41582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.225284:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788969847.225399:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741435264:0@lo:253: 10000000:01000000:0.0:1788969847.225416:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788969847.225419:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788969847.225421:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788969847.225422:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788969847.225424:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788969847.225425:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788969847.225426:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788969847.225428:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788969847.225429:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788969847.225431:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788969847.225432:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788969847.225453:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9778601fa800 from lustre-OST0000 10000000:01000000:0.0:1788969847.225476:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788969847.225479:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788969847.225485:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9778652a99c0 local copy 10000000:01000000:0.0:1788969847.225489:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788969847.225523:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.225534:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.225544:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.225563:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436160:0@lo:101: 00000100:00100000:0.0:1788969847.225610:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.225667:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788969847.225783:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741436160 00000100:00100000:1.0:1788969847.225818:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741436160 00000100:00100000:1.0:1788969847.225869:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788969847.225879:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+9:6674:x1875870741436160:12345-0@lo:101: 00010000:00010000:1.0:1788969847.225893:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969847.225906:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b38ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b38e3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.225927:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b38ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b38e3 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.225939:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b38ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b38e3 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.225947:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9e00, rc 0) 00000100:00100000:1.0:1788969847.225974:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+10:6674:x1875870741436160:12345-0@lo:101: Request processed in 98us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969847.225981:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788969847.226053:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436160:0@lo:101: 00010000:00010000:0.0:1788969847.226065:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.226074:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.226171:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436288:0@lo:501: 00000100:00100000:0.0:1788969847.226194:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.226211:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.226267:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741436288 00000100:00100000:2.0:1788969847.226271:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741436288 00000100:00100000:2.0:1788969847.226302:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788969847.226309:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+10:6674:x1875870741436288:12345-0@lo:501: 00000100:00100000:2.0:1788969847.226641:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+10:6674:x1875870741436288:12345-0@lo:501: Request processed in 332us (445us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788969847.226648:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788969847.226705:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436288:0@lo:501: 10000000:01000000:0.0:1788969847.226717:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788969847.226742:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788969847.226747:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.226755:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.226762:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.226785:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788969847.226840:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9778601fa800 10000000:01000000:0.0:1788969847.226845:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788969847.226850:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9778652a99c0 10000000:01000000:0.0:1788969847.226858:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788969847.226862:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9778652a99c0 from 1 10000000:01000000:0.0:1788969847.226864:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788969847.226881:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.226888:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.226895:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.226907:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436416:0@lo:101: 00000100:00100000:0.0:1788969847.226931:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.226948:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99540 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.226998:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741436416 00000100:00100000:2.0:1788969847.227003:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741436416 00000100:00100000:2.0:1788969847.227031:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788969847.227037:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+10:6674:x1875870741436416:12345-0@lo:101: 00010000:00010000:2.0:1788969847.227049:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969847.227059:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38f8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b38f1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.227075:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b38f1 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.227083:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b38f1 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.227090:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd000, rc 0) 00000100:00100000:2.0:1788969847.227116:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741436416:12345-0@lo:101: Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.227122:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788969847.227192:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436416:0@lo:101: 00010000:00010000:0.0:1788969847.227202:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b38f8 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.227210:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b38f8 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969847.227221:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788969847.227236:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b38f8 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.227242:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b38f8 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969847.227248:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788969847.227256:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788969847.227260:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788969847.227262:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788969847.227274:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.227281:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.227288:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.227298:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436544:0@lo:101: 00000100:00100000:0.0:1788969847.227321:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.227343:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99540 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.227449:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741436544 00000100:00100000:2.0:1788969847.227453:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741436544 00000100:00100000:2.0:1788969847.227481:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788969847.227487:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741436544:12345-0@lo:101: 00010000:00010000:2.0:1788969847.227494:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969847.227501:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b38ff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.227513:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b38ff expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.227522:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b38ff expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.227528:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd600, rc 0) 00000100:00100000:2.0:1788969847.227557:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741436544:12345-0@lo:101: Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.227563:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788969847.227622:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788969847.227628:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.227636:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788969847.227640:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.227659:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788969847.227666:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969847.227672:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788969847.227689:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.227696:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788969847.227722:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.227729:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b38e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d0de860b05b38ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.227742:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969847.227744:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969847.227746:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969847.227753:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788969847.227762:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741436672:0@lo:103: 00000100:00100000:1.0:1788969847.227820:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969847.227870:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741436672 00000100:00100000:1.0:1788969847.227874:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741436672 00000100:00100000:1.0:1788969847.227903:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788969847.227910:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3286:x1875870741436672:12345-0@lo:103: 00010000:00010000:1.0:1788969847.227918:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969847.227928:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b38ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b38e3 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.227945:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969847.227973:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:3286:x1875870741436672:12345-0@lo:103: Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969847.227979:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788969847.228007:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741436672:0@lo:103: 00000100:00100000:0.0:1788969847.228109:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436544:0@lo:101: 00010000:00010000:0.0:1788969847.228120:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.228128:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.228193:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436800:0@lo:501: 00000100:00100000:0.0:1788969847.228216:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.228238:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99540 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.228287:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741436800 00000100:00100000:2.0:1788969847.228292:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741436800 00000100:00100000:2.0:1788969847.228324:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788969847.228340:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741436800:12345-0@lo:501: 00000100:00100000:2.0:1788969847.228524:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741436800:12345-0@lo:501: Request processed in 184us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.228530:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788969847.228648:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436800:0@lo:501: 00000100:00100000:1.0:1788969847.228673:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436928:0@lo:503: 00000100:00100000:1.0:1788969847.228707:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969847.228728:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.228774:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741436928 00000100:00100000:2.0:1788969847.228778:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741436928 00000100:00100000:2.0:1788969847.228836:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788969847.228843:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741436928:12345-0@lo:503: 00000100:00100000:2.0:1788969847.228969:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741436928:12345-0@lo:503: Request processed in 127us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.228976:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788969847.229068:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741436928:0@lo:503: 00000040:00080000:1.0:1788969847.229407:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788969847.229457:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437056:0@lo:502: 00000100:00100000:1.0:1788969847.229493:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969847.229512:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788969847.229567:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741437056 00000100:00100000:0.0:1788969847.229572:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741437056 00000100:00100000:0.0:1788969847.229594:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788969847.229600:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741437056:12345-0@lo:502: 00000100:00100000:0.0:1788969847.229744:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741437056:12345-0@lo:502: Request processed in 143us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.229751:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788969847.229897:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437056:0@lo:502: 00000040:00080000:1.0:1788969847.230108:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788969847.230154:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788969847.230190:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788969847.230253:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788969847.230291:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788969847.230323:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788969847.230617:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437184:0@lo:502: 00000100:00100000:2.0:1788969847.230657:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969847.230722:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977852a5e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788969847.230755:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741437184 00000100:00100000:0.0:1788969847.230759:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741437184 00000100:00100000:0.0:1788969847.230902:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788969847.230910:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741437184:12345-0@lo:502: 00000100:00100000:0.0:1788969847.231087:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741437184:12345-0@lo:502: Request processed in 177us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.231094:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788969847.231434:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437184:0@lo:502: 00000040:00080000:3.0:1788969847.231535:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788969847.231545:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788969847.232054:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788969847.232062:0:6692:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788969847.232068:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969847.232070:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788969847.232076:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788969847.232090:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9778652f99c0) 00000020:00000080:2.0:1788969847.232110:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788969847.232115:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788969847.232176:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9778601fa800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788969847.232183:0:6692:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788969847.232190:0:6692:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d0de860b05b3914 00010000:00010000:2.0:1788969847.236608:0:6692:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788969847.236982:0:6692:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788969847.239400:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788969847.239739:0:6692:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788969847.246702:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788969847.247320:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788969847.248917:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788969847.248929:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788969847.248936:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969847.248938:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788969847.248941:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788969847.248945:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969847.248946:0:6692:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788969847.248949:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788969847.248951:0:6692:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788969847.249005:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788969847.249008:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969847.249010:0:6692:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788969847.249013:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788969847.249204:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788969847.249230:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788969847.249252:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969847.249264:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969847.249272:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9778601fa800 from 1 10000000:01000000:3.0:1788969847.249274:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788969847.249309:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969847.249319:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969847.249435:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969847.249458:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437312:0@lo:101: 00000100:00100000:3.0:1788969847.249522:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969847.249620:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741437312 00000100:00100000:2.0:1788969847.249627:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741437312 00000100:00100000:2.0:1788969847.249664:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788969847.249674:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:6674:x1875870741437312:12345-0@lo:101: 00010000:00010000:2.0:1788969847.249686:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969847.249698:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b391b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.249719:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b391b expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.249741:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b391b expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.249749:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc600, rc 0) 00000100:00100000:2.0:1788969847.249782:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437312:12345-0@lo:101: Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.249812:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788969847.249895:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37900 going to sleep for 11 seconds 00000100:00100000:3.0:1788969847.249915:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437312:0@lo:101: 00010000:00010000:3.0:1788969847.249928:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969847.249936:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969847.250019:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437440:0@lo:501: 00000100:00100000:3.0:1788969847.250043:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.250457:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741437440 00000100:00100000:0.0:1788969847.250463:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741437440 00000100:00100000:0.0:1788969847.250490:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788969847.250497:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437440:12345-0@lo:501: 00000100:00100000:0.0:1788969847.250696:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437440:12345-0@lo:501: Request processed in 198us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.250703:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788969847.252077:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37900 going to sleep for 11 seconds 00000100:00100000:3.0:1788969847.252110:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437440:0@lo:501: 00000100:00100000:3.0:1788969847.252156:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437568:0@lo:503: 00000100:00100000:3.0:1788969847.252208:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969847.252908:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37900 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.252957:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741437568 00000100:00100000:2.0:1788969847.252964:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741437568 00000100:00100000:2.0:1788969847.252999:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788969847.253007:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437568:12345-0@lo:503: 00000100:00100000:2.0:1788969847.254964:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437568:12345-0@lo:503: Request processed in 1952us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.254975:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788969847.255078:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437568:0@lo:503: 00000040:00080000:3.0:1788969847.256092:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788969847.256163:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437696:0@lo:502: 00000100:00100000:3.0:1788969847.256214:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969847.256251:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37900 going to sleep for 11 seconds 00000100:00100000:1.0:1788969847.256369:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741437696 00000100:00100000:1.0:1788969847.256375:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741437696 00000100:00100000:1.0:1788969847.256412:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788969847.256421:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437696:12345-0@lo:502: 00000100:00100000:1.0:1788969847.256621:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437696:12345-0@lo:502: Request processed in 201us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969847.256627:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788969847.256783:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437696:0@lo:502: 00000040:00080000:3.0:1788969847.257098:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788969847.257145:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788969847.257167:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437824:0@lo:502: 00000100:00100000:3.0:1788969847.257200:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969847.257263:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37900 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.257386:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741437824 00000100:00100000:2.0:1788969847.257391:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741437824 00000100:00100000:2.0:1788969847.257450:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788969847.257458:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437824:12345-0@lo:502: 00000100:00100000:2.0:1788969847.257595:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437824:12345-0@lo:502: Request processed in 137us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.257601:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788969847.257663:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437824:0@lo:502: 00000040:00080000:3.0:1788969847.257736:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788969847.257746:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788969847.260355:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788969847.260367:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788969847.260369:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788969847.260387:0:6696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9778601fa800 00000020:00000080:3.0:1788969847.260390:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788969847.260414:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788969847.260417:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788969847.260419:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788969847.260422:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788969847.260587:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788969847.260609:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788969847.260633:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.260645:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969847.260685:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788969847.260688:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9778601fa800 10000000:01000000:0.0:1788969847.260691:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9778601fa800 10000000:01000000:0.0:1788969847.260702:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788969847.260709:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9778601fa800 from 1 10000000:01000000:0.0:1788969847.260712:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788969847.260743:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.260752:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.260762:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.260784:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437952:0@lo:101: 00000100:00100000:0.0:1788969847.260877:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.260907:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778434066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.261073:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741437952 00000100:00100000:2.0:1788969847.261080:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741437952 00000100:00100000:2.0:1788969847.261161:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788969847.261171:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741437952:12345-0@lo:101: 00010000:00010000:2.0:1788969847.261183:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969847.261203:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3929 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.261225:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3929 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.261236:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3929 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.261244:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc000, rc 0) 00000100:00100000:2.0:1788969847.261293:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741437952:12345-0@lo:101: Request processed in 125us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.261299:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788969847.261368:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741437952:0@lo:101: 00010000:00010000:0.0:1788969847.261384:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969847.261392:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969847.261472:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438080:0@lo:501: 00000100:00100000:0.0:1788969847.261495:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.261653:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778434066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969847.261720:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741438080 00000100:00100000:1.0:1788969847.261725:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741438080 00000100:00100000:1.0:1788969847.261746:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788969847.261752:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741438080:12345-0@lo:501: 00000100:00100000:1.0:1788969847.262020:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741438080:12345-0@lo:501: Request processed in 267us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969847.262027:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788969847.262158:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438080:0@lo:501: 00000100:00100000:0.0:1788969847.262183:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438208:0@lo:503: 00000100:00100000:0.0:1788969847.262215:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.262240:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778434066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969847.262274:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741438208 00000100:00100000:1.0:1788969847.262277:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741438208 00000100:00100000:1.0:1788969847.262292:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788969847.262297:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741438208:12345-0@lo:503: 00000100:00100000:1.0:1788969847.262430:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741438208:12345-0@lo:503: Request processed in 132us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969847.262436:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788969847.262542:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438208:0@lo:503: 00000040:00080000:0.0:1788969847.262756:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788969847.262855:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438336:0@lo:502: 00000100:00100000:0.0:1788969847.262885:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.262899:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977843053180 going to sleep for 11 seconds 00000100:00100000:1.0:1788969847.263149:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741438336 00000100:00100000:1.0:1788969847.263154:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741438336 00000100:00100000:1.0:1788969847.263170:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788969847.263175:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741438336:12345-0@lo:502: 00000100:00100000:1.0:1788969847.263310:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741438336:12345-0@lo:502: Request processed in 134us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969847.263316:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788969847.263408:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438336:0@lo:502: 00000040:00080000:0.0:1788969847.263640:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788969847.263685:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788969847.263717:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788969847.263761:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788969847.264110:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788969847.264159:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788969847.264195:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788969847.264228:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788969847.264274:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788969847.264307:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788969847.264427:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788969847.264478:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788969847.264513:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788969847.264542:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788969847.264605:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788969847.264638:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788969847.264669:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788969847.264716:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788969847.264751:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788969847.264994:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788969847.265046:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788969847.265084:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788969847.265116:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788969847.265173:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788969847.265218:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788969847.265252:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788969847.265298:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788969847.265504:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788969847.265545:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438464:0@lo:502: 00000100:00100000:0.0:1788969847.265596:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.265810:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977843053180 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.265989:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741438464 00000100:00100000:2.0:1788969847.265996:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741438464 00000100:00100000:2.0:1788969847.266030:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788969847.266038:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741438464:12345-0@lo:502: 00000100:00100000:2.0:1788969847.266239:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741438464:12345-0@lo:502: Request processed in 200us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.266246:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788969847.266323:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438464:0@lo:502: 00000040:00080000:0.0:1788969847.266401:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788969847.266411:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788969847.266995:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788969847.267008:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9778500519c0) 00000020:00000080:0.0:1788969847.267026:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788969847.267102:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9778601fa800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788969847.267106:0:6697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9778601fa800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788969847.267108:0:6697:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9778601fa800 3 00010000:00080000:0.0:1788969847.267136:0:6697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97787f7e5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788969847.269981:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788969847.270269:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788969847.270302:0:6697:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788969847.270314:0:6697:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d0de860b05b393e 00000100:00080000:0.0:1788969847.270322:0:6697:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788969847.270343:0:6697:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97787f7e5000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788969847.270373:0:6697:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff977855c17480 x1875870741438592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788969847.270426:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741438592:0@lo:38: 00000100:00100000:3.0:1788969847.270482:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788969847.270531:0:6697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788969847.270580:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969847.270589:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741438720:0@lo:400: 00000100:00100000:0.0:1788969847.270624:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969847.270655:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741438592 00000100:00100000:0.0:1788969847.270660:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741438592 00000100:00100000:0.0:1788969847.270682:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741438720 00000100:00100000:0.0:1788969847.270684:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741438720 00000100:00100000:0.0:1788969847.270706:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788969847.270715:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741438720:12345-0@lo:400: 00000100:00100000:0.0:1788969847.271860:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741438720:12345-0@lo:400: Request processed in 51us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.271873:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788969847.271896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788969847.271901:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875870741438592:12345-0@lo:38: 00010000:00080000:0.0:1788969847.271923:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:0.0:1788969847.271964:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d0de860b05b3945 00000004:00100000:0.0:1788969847.271978:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788969847.272005:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97787f7e6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788969847.276161:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875870741438592:12345-0@lo:38: Request processed in 4247us (5667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969847.276175:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788969847.276245:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff977855c14000 x1875870741438720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969847.276260:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741438720:0@lo:400: 00010000:00080000:3.0:1788969847.277936:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff977855c17480 x1875870741438592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788969857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969847.277949:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788969847.277959:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788969847.277967:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788969847.277972:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788969847.277976:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787f7e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788969847.277982:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741438592:0@lo:38: 00000040:00080000:0.0:1788969847.278899:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788969847.279101:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788969847.279124:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788969847.279141:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969847.279152:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788969847.279201:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788969847.279204:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788969847.279205:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788969847.279206:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788969847.279207:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788969847.279213:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788969847.279215:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788969847.279216:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788969847.279218:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788969847.279219:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788969847.279220:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788969847.279224:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788969847.279226:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788969847.279227:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788969847.279228:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788969847.279229:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788969847.279231:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788969847.279232:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788969847.279232:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788969847.279233:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788969847.279234:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788969847.279235:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788969847.279236:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788969847.279270:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788969847.279285:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438848:0@lo:253: 00000100:00100000:3.0:1788969847.279358:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969847.279391:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788969847.279409:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741438848 00000100:00100000:3.0:1788969847.279415:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741438848 00000100:00100000:3.0:1788969847.279449:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788969847.279457:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:6674:x1875870741438848:12345-0@lo:253: 20000000:01000000:3.0:1788969847.279479:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788969847.279491:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788969847.311179:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788969847.311201:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788969847.311257:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788969847.311262:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788969847.311283:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.311315:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977841545600/0x5d0de860b05b38a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b389d expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.311323:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.311371:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977841545600/0x5d0de860b05b38a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b389d expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969847.311386:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977841545600/0x5d0de860b05b38a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b389d expref: 13 pid: 5825 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969847.311401:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cde00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875870741438976:0@lo:104: 00000100:00100000:1.0:1788969847.311461:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969847.311512:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff977858dab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788969847.311570:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741438976 00000100:00100000:2.0:1788969847.311578:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741438976 00000100:00100000:2.0:1788969847.311625:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788969847.311634:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5848:x1875870741438976:12345-0@lo:104: 00010000:00010000:2.0:1788969847.311647:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778414a8e00/0x5d0de860b05b389d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.311698:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788969847.311709:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5848:x1875870741438976:12345-0@lo:104: Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.311716:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788969847.311737:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788969847.311742:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778414a8e00/0x5d0de860b05b389d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.311749:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788969847.311752:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8e00/0x5d0de860b05b389d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.311760:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778414a8e00/0x5d0de860b05b389d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788969847.311779:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8e00/0x5d0de860b05b389d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788969847.311784:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788969847.311844:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778414a8e00/0x5d0de860b05b389d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.311851:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788969847.311867:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778414a8e00/0x5d0de860b05b389d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.311874:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778414a8e00/0x5d0de860b05b389d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b38a4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.311890:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969847.311892:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969847.311894:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969847.311920:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741439104:0@lo:103: 00000100:00100000:2.0:1788969847.311951:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969847.311990:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741439104 00000100:00100000:2.0:1788969847.311994:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741439104 00010000:00010000:2.0:1788969847.312008:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977841545600/0x5d0de860b05b38a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b389d expref: 14 pid: 5825 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969847.312030:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788969847.312036:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778600e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3283:x1875870741439104:12345-0@lo:103: 00010000:00010000:2.0:1788969847.312047:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788969847.312051:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977841545600/0x5d0de860b05b38a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b389d expref: 14 pid: 5825 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312061:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977841545600/0x5d0de860b05b38a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b389d expref: 14 pid: 5825 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312075:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312083:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788969847.312095:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001262388s 00010000:00010000:2.0:1788969847.312099:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312106:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312113:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312129:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312134:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788969847.312138:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312146:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312154:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312163:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969847.312193:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778600e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3283:x1875870741439104:12345-0@lo:103: Request processed in 157us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969847.312200:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788969847.312259:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741439104:0@lo:103: 00010000:00010000:2.0:1788969847.312296:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841545600/0x5d0de860b05b38a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b389d expref: 13 pid: 5825 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969847.312304:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cde00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875870741438976:0@lo:104: 00010000:00010000:2.0:1788969847.312315:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312323:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312329:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969847.312340:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b394c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969847.322219:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:6674:x1875870741438848:12345-0@lo:253: Request processed in 42751us (42849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969847.322233:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788969847.322401:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:6674:1875870741438848:0@lo:253: 10000000:01000000:0.0:1788969847.322417:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788969847.322420:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788969847.322435:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788969847.322437:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788969847.322438:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788969847.322440:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788969847.322441:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788969847.322442:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788969847.322443:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788969847.322445:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788969847.322446:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788969847.322448:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788969847.322463:0:6674:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788969847.335266:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788969847.335547:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788969847.335766:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788969847.335980:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788969847.336174:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788969847.337599:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788969847.340775:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788969847.645681:0:6674:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788969847.645688:0:6674:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788969847.645721:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788969847.645780:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788969847.645926:0:6674:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788969847.646027:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788969847.877002:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969848.908894:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969849.935090:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969850.948945:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969851.973046:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969852.356947:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788969852.356973:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741439232:0@lo:400: 00000100:00100000:0.0:1788969852.357041:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969852.357096:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741439360:0@lo:400: 00000100:00100000:0.0:1788969852.357123:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969852.357144:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969852.357149:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741439488:0@lo:400: 00000100:00100000:0.0:1788969852.357173:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969852.357203:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741439232 00000100:00100000:0.0:1788969852.357210:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741439232 00000100:00100000:0.0:1788969852.357250:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788969852.357257:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3283:x1875870741439232:12345-0@lo:400: 00000100:00100000:0.0:1788969852.357315:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3283:x1875870741439232:12345-0@lo:400: Request processed in 58us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969852.357332:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788969852.357393:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741439360 00000100:00100000:0.0:1788969852.357398:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741439360 00000100:00100000:0.0:1788969852.357420:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741439488 00000100:00100000:0.0:1788969852.357423:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741439488 00000100:00100000:0.0:1788969852.357447:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788969852.357454:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741439360:12345-0@lo:400: 00000100:00100000:0.0:1788969852.357489:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741439360:12345-0@lo:400: Request processed in 35us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969852.357495:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788969852.357507:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788969852.357512:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741439488:12345-0@lo:400: 00000100:00100000:0.0:1788969852.357539:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741439488:12345-0@lo:400: Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969852.357544:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788969852.357582:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741439232:0@lo:400: 00000100:00080000:0.0:1788969852.357605:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788969852.357621:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855c14780 x1875870741439488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969852.357632:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741439488:0@lo:400: 00010000:00080000:0.0:1788969852.357641:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855c14000 x1875870741439360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969852.357649:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741439360:0@lo:400: 00010000:00010000:2.0:1788969852.997922:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969854.023021:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788969854.810636:0:7042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788969854.918438:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788969854.918446:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97786f03a800 from 21 10000000:01000000:3.0:1788969854.918452:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788969854.918555:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.918567:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.918579:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969854.918604:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741439616:0@lo:101: 00000100:00100000:3.0:1788969854.918668:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.918721:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871300 going to sleep for 11 seconds 00000100:00100000:1.0:1788969854.920027:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741439616 00000100:00100000:1.0:1788969854.920038:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741439616 00000100:00100000:1.0:1788969854.920095:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788969854.920105:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741439616:12345-0@lo:101: 00010000:00010000:1.0:1788969854.920119:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969854.920146:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3953 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969854.920170:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3953 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969854.920181:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3953 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969854.920190:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8e00, rc 0) 00000100:00100000:1.0:1788969854.920260:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741439616:12345-0@lo:101: Request processed in 157us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969854.920266:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788969854.922158:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741439616:0@lo:101: 00010000:00010000:3.0:1788969854.922185:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.922198:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969854.922302:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741439744:0@lo:501: 00000100:00100000:3.0:1788969854.922367:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.922416:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871300 going to sleep for 11 seconds 00000100:00100000:1.0:1788969854.924103:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741439744 00000100:00100000:1.0:1788969854.924115:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741439744 00000100:00100000:1.0:1788969854.924174:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788969854.924183:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741439744:12345-0@lo:501: 00000100:00100000:1.0:1788969854.924693:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741439744:12345-0@lo:501: Request processed in 510us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969854.924701:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788969854.931934:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741439744:0@lo:501: 00000100:00100000:3.0:1788969854.931996:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741439872:0@lo:503: 00000100:00100000:3.0:1788969854.932063:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.932103:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871300 going to sleep for 11 seconds 00000100:00100000:3.0:1788969854.932124:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741439872 00000100:00100000:3.0:1788969854.932132:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741439872 00000100:00100000:3.0:1788969854.932184:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788969854.932192:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741439872:12345-0@lo:503: 00000100:00100000:3.0:1788969854.934046:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741439872:12345-0@lo:503: Request processed in 1845us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969854.934061:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788969854.934184:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741439872:0@lo:503: 00000100:00100000:3.0:1788969854.947998:0:7048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:7048:1875870741440000:0@lo:502: 00000100:00100000:3.0:1788969854.948078:0:7048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.948124:0:7048:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871840 going to sleep for 11 seconds 00000100:00100000:1.0:1788969854.948348:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741440000 00000100:00100000:1.0:1788969854.948357:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741440000 00000100:00100000:1.0:1788969854.948409:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788969854.948418:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7048:x1875870741440000:12345-0@lo:502: 00000100:00100000:1.0:1788969854.948749:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7048:x1875870741440000:12345-0@lo:502: Request processed in 331us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969854.948878:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788969854.951490:0:7048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:7048:1875870741440000:0@lo:502: 00000100:00100000:0.0:1788969854.951618:0:7048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:7048:1875870741440128:0@lo:502: 00000100:00100000:0.0:1788969854.951699:0:7048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969854.951744:0:7048:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844fdd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788969854.951907:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741440128 00000100:00100000:3.0:1788969854.951914:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741440128 00000100:00100000:3.0:1788969854.951961:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788969854.951969:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7048:x1875870741440128:12345-0@lo:502: 00000100:00100000:3.0:1788969854.952180:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7048:x1875870741440128:12345-0@lo:502: Request processed in 210us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969854.952192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788969854.952928:0:7048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:7048:1875870741440128:0@lo:502: 00000040:00080000:0.0:1788969854.952955:0:7048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788969854.953132:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788969854.953148:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788969854.953158:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.953171:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969854.953182:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788969854.953184:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97786f03a800 from 4 10000000:01000000:3.0:1788969854.953187:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788969854.953214:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.953229:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.953239:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969854.953255:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440256:0@lo:101: 00000100:00100000:3.0:1788969854.953292:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.953330:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871240 going to sleep for 11 seconds 00000100:00100000:0.0:1788969854.957740:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741440256 00000100:00100000:0.0:1788969854.957769:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741440256 00000100:00100000:0.0:1788969854.957865:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788969854.957876:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741440256:12345-0@lo:101: 00010000:00010000:0.0:1788969854.957891:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969854.957912:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3961 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969854.957942:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3961 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969854.957954:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3961 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969854.957963:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4000, rc 0) 00000100:00100000:0.0:1788969854.958037:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741440256:12345-0@lo:101: Request processed in 163us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969854.958045:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788969854.958384:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440256:0@lo:101: 00010000:00010000:3.0:1788969854.958404:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.958414:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969854.958485:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440384:0@lo:256: 00000100:00100000:3.0:1788969854.958524:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.958564:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871240 going to sleep for 11 seconds 00000100:00100000:0.0:1788969854.960327:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741440384 00000100:00100000:0.0:1788969854.960341:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741440384 00000100:00100000:0.0:1788969854.960403:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788969854.960413:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741440384:12345-0@lo:256: 20000000:01000000:0.0:1788969854.960435:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788969854.960465:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788969854.960468:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788969854.960579:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741440384:12345-0@lo:256: Request processed in 167us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969854.960587:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788969854.960689:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440384:0@lo:256: 10000000:01000000:3.0:1788969854.960738:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788969854.960746:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.960768:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969854.960820:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788969854.960824:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788969854.960826:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788969854.960853:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.960861:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.960869:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969854.960887:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440512:0@lo:101: 00000100:00100000:3.0:1788969854.960918:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.960938:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871240 going to sleep for 11 seconds 00000100:00100000:3.0:1788969854.960954:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741440512 00000100:00100000:3.0:1788969854.960957:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741440512 00000100:00100000:3.0:1788969854.960979:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788969854.960985:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741440512:12345-0@lo:101: 00010000:00010000:3.0:1788969854.960994:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969854.961005:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b396f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.961025:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b396f expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.961034:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b396f expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.961053:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841544600, rc 0) 00000100:00100000:3.0:1788969854.961083:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741440512:12345-0@lo:101: Request processed in 97us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969854.961089:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788969854.961116:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440512:0@lo:101: 00010000:00010000:3.0:1788969854.961128:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969854.961150:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969854.961195:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440640:0@lo:501: 00000100:00100000:3.0:1788969854.961219:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.961231:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871240 going to sleep for 11 seconds 00000100:00100000:3.0:1788969854.961244:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741440640 00000100:00100000:3.0:1788969854.961247:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741440640 00000100:00100000:3.0:1788969854.961264:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788969854.961269:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741440640:12345-0@lo:501: 00000100:00100000:3.0:1788969854.961512:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741440640:12345-0@lo:501: Request processed in 242us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969854.961518:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788969854.961542:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440640:0@lo:501: 00000100:00100000:3.0:1788969854.961563:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440768:0@lo:503: 00000100:00100000:3.0:1788969854.961595:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.961606:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871240 going to sleep for 11 seconds 00000100:00100000:3.0:1788969854.961621:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741440768 00000100:00100000:3.0:1788969854.961624:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741440768 00000100:00100000:3.0:1788969854.961638:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788969854.961643:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741440768:12345-0@lo:503: 00000100:00100000:3.0:1788969854.961930:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741440768:12345-0@lo:503: Request processed in 285us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969854.961937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788969854.961972:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741440768:0@lo:503: 00000100:00100000:3.0:1788969854.965678:0:7049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:7049:1875870741440896:0@lo:502: 00000100:00100000:3.0:1788969854.967975:0:7049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969854.968059:0:7049:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742871a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788969854.970586:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741440896 00000100:00100000:0.0:1788969854.970601:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741440896 00000100:00100000:0.0:1788969854.970657:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788969854.970668:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:7049:x1875870741440896:12345-0@lo:502: 00000100:00100000:0.0:1788969854.971128:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:7049:x1875870741440896:12345-0@lo:502: Request processed in 460us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969854.971136:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788969854.973585:0:7049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:7049:1875870741440896:0@lo:502: 00000020:01000000:3.0:1788969854.973640:0:7049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788969854.973648:0:7049:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788969854.973659:0:7049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788969854.973661:0:7049:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788969854.973667:0:7049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788969854.973671:0:7049:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:3.0:1788969854.973696:0:7049:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788969854.973699:0:7049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788969854.973715:0:7049:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9778650e8000) 00000020:00000080:3.0:1788969854.973771:0:7049:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788969854.973780:0:7049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788969854.973966:0:7049:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788969854.973972:0:7049:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788969854.973980:0:7049:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b3984 00010000:00080000:3.0:1788969854.974010:0:7049:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97787882a000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:3.0:1788969854.974234:0:7049:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:2.0:1788969855.052624:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788969855.105041:0:7049:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788969855.105066:0:7049:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788969855.107068:0:7049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788969855.117138:0:7049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788969855.117223:0:7049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788969855.117481:0:7049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788969855.119602:0:7059:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788969855.119609:0:7059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788969855.121493:0:7049:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788969855.121507:0:7049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788969855.121543:0:7049:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788969855.121567:0:7049:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b398b 00000100:00080000:1.0:1788969855.121581:0:7049:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788969855.121593:0:7049:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97787882a000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1788969855.121631:0:7049:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778615cf0c0 x1875870741441024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788969855.121660:0:7049:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788969855.121717:0:7049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788969855.121721:0:7049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969855.121723:0:7049:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788969855.121726:0:7049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788969855.121730:0:7049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969855.121732:0:7049:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788969855.121735:0:7049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788969855.121737:0:7049:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788969855.121779:0:7049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:7049:1875870741441152:0@lo:502: 00000100:00100000:2.0:1788969855.121942:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741441024:0@lo:8: 00000100:00100000:2.0:1788969855.122218:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969855.122303:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741441024 00000100:00100000:2.0:1788969855.122310:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741441024 00000100:00100000:2.0:1788969855.122342:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788969855.122348:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875870741441024:12345-0@lo:8: 00010000:00080000:2.0:1788969855.122370:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:2.0:1788969855.122396:0:6676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b3992 00002000:00100000:2.0:1788969855.122427:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97787f51f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788969855.122431:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788969855.122435:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788969855.122552:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788969855.122687:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788969855.122713:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9778601f8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788969855.124576:0:7049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969855.124614:0:7049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784723d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788969855.124701:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741441408:0@lo:400: 00000100:00100000:1.0:1788969855.124737:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969855.124994:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741441152 00000100:00100000:0.0:1788969855.125003:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741441152 00000100:00100000:0.0:1788969855.125045:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788969855.125054:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:7049:x1875870741441152:12345-0@lo:502: 00000100:00100000:2.0:1788969855.125412:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875870741441024:12345-0@lo:8: Request processed in 3060us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969855.125429:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788969855.125485:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778615cf0c0 x1875870741441024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788969865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969855.125497:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788969855.125505:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788969855.125513:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788969855.125518:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788969855.125521:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787882a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788969855.125533:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788969855.125539:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741441024:0@lo:8: 00000004:00080000:2.0:1788969855.125567:0:7059:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788969855.125675:0:7059:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167088884978ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788969855.126437:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788969855.126452:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741441280:0@lo:400: 00000100:00100000:1.0:1788969855.126502:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969855.126653:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:7049:x1875870741441152:12345-0@lo:502: Request processed in 1600us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969855.126664:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788969855.126720:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741441408 00000100:00100000:0.0:1788969855.126726:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741441408 00000100:00100000:0.0:1788969855.132655:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741441280 00000100:00100000:0.0:1788969855.132669:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741441280 00000100:00100000:0.0:1788969855.132717:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788969855.132728:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741441408:12345-0@lo:400: 00000100:00100000:1.0:1788969855.132989:0:5834:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788969855.133015:0:5834:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788969855.137219:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741441408:12345-0@lo:400: Request processed in 4484us (12470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969855.137233:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788969855.137421:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788969855.137437:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741441280:12345-0@lo:400: 00000100:00100000:0.0:1788969855.137492:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741441280:12345-0@lo:400: Request processed in 62us (10990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969855.137498:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788969855.137525:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969855.137567:0:7049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:7049:1875870741441152:0@lo:502: 00000020:01000000:0.0:1788969855.137613:0:7049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788969855.137620:0:7049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788969855.137623:0:7049:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788969855.137628:0:7049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788969855.137784:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00010000:00080000:2.0:1788969855.138189:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778615cf480 x1875870741441280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969855.138204:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741441280:0@lo:400: 00010000:00080000:2.0:1788969855.138227:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778615ce940 x1875870741441408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969855.138236:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741441408:0@lo:400: 10000000:01000000:0.0:1788969855.138927:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788969855.138940:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969855.138952:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969855.138961:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788969855.138964:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9778652a99c0 from 1 10000000:01000000:0.0:1788969855.138966:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788969855.138997:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969855.139005:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969855.139014:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969855.139916:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741441536:0@lo:101: 00000100:00100000:0.0:1788969855.139986:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969855.140032:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977845502d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788969855.140398:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741441536 00000100:00100000:0.0:1788969855.140409:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741441536 00000100:00100000:0.0:1788969855.140454:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788969855.140463:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741441536:12345-0@lo:101: 00010000:00010000:0.0:1788969855.140477:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969855.140493:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3999 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969855.140518:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3999 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969855.140529:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3999 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969855.140538:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4a00, rc 0) 00000100:00100000:0.0:1788969855.140578:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741441536:12345-0@lo:101: Request processed in 116us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969855.140585:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788969855.140636:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741441536:0@lo:101: 00010000:00010000:0.0:1788969855.140652:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969855.140661:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969855.140736:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741441664:0@lo:501: 00000100:00100000:0.0:1788969855.140779:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969855.143973:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977845502d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788969855.146911:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741441664 00000100:00100000:2.0:1788969855.146925:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741441664 00000100:00100000:2.0:1788969855.146969:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788969855.146977:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741441664:12345-0@lo:501: 00000100:00100000:2.0:1788969855.147213:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741441664:12345-0@lo:501: Request processed in 236us (6432us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788969855.147220:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788969855.147708:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741441664:0@lo:501: 10000000:01000000:2.0:1788969855.147740:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788969855.147760:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969855.147772:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788969855.208290:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788969855.306684:0:7060:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788969855.306728:0:7060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7060:1875870741441920:0@lo:7: 00000100:00100000:2.0:1788969855.306836:0:7060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969855.306890:0:7060:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969855.306921:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741441920 00000100:00100000:2.0:1788969855.306926:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741441792:0@lo:13: 00000100:00100000:1.0:1788969855.306930:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741441920 00000100:00100000:2.0:1788969855.306951:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969855.306979:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788969855.306988:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7060:x1875870741441920:12345-0@lo:7: 00000100:00100000:2.0:1788969855.307025:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741441792 00000100:00100000:2.0:1788969855.307028:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741441792 00000100:00100000:2.0:1788969855.307059:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788969855.307066:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741441792:12345-0@lo:13: 00002000:00000024:2.0:1788969855.307089:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788969855.307132:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741441792:12345-0@lo:13: Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969855.307138:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788969855.307183:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778616d7480 x1875870741441792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969855.307201:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741441792:0@lo:13: 00000100:00080000:0.0:1788969855.310341:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788969855.317907:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788969855.317917:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788969855.318026:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7060:x1875870741441920:12345-0@lo:7: Request processed in 11034us (11186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969855.318037:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788969855.318369:0:7060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778616d52c0 x1875870741441920/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788969871 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969855.318387:0:7060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7060:1875870741441920:0@lo:7: 00000004:00080000:0.0:1788969855.318402:0:7060:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788969855.318442:0:7060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7060:1875870741442048:0@lo:5: 00000100:00100000:0.0:1788969855.318481:0:7060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969855.318530:0:7060:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32900 going to sleep for 11 seconds 00000100:00100000:2.0:1788969855.318892:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741442048 00000100:00100000:2.0:1788969855.318900:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741442048 00000100:00100000:2.0:1788969855.318943:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788969855.318953:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7060:x1875870741442048:12345-0@lo:5: 00002000:00080000:2.0:1788969855.318982:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788969855.318987:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788969855.319512:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7060:x1875870741442048:12345-0@lo:5: Request processed in 560us (1029us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788969855.319520:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788969855.319843:0:7060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855c14780 x1875870741442048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788969871 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969855.319862:0:7060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7060:1875870741442048:0@lo:5: 00000004:00080000:0.0:1788969855.319873:0:7060:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788969855.320011:0:7060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7060:1875870741442176:0@lo:700: 00000100:00100000:2.0:1788969855.320084:0:7060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969855.320116:0:7060:0:(client.c:2716:ptlrpc_set_wait()) set ffff977858dabcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969855.320812:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741442176 00000100:00100000:1.0:1788969855.320819:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741442176 00000100:00100000:1.0:1788969855.320853:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788969855.320860:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7060:x1875870741442176:12345-0@lo:700: 00000100:00100000:1.0:1788969855.320897:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cc780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1875870741442304:0@lo:700: 00000100:00100000:1.0:1788969855.320954:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969855.320983:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d2ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788969855.324259:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741442304 00000100:00100000:2.0:1788969855.324278:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741442304 00000100:00100000:2.0:1788969855.324337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788969855.324347:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1875870741442304:12345-0@lo:700: 40000000:02000000:2.0:1788969855.431480:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788969855.437972:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1875870741442304:12345-0@lo:700: Request processed in 113617us (117007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969855.437987:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788969855.438223:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778615cc780 x1875870741442304/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788969871 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969855.438240:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cc780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1875870741442304:0@lo:700: 40000000:02000000:2.0:1788969855.438305:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788969855.584631:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788969855.584646:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788969855.584848:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7060:x1875870741442176:12345-0@lo:700: Request processed in 263983us (264758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969855.584869:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788969855.584928:0:7060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778616d7480 x1875870741442176/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788969871 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969855.584940:0:7060:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788969855.584956:0:7060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7060:1875870741442176:0@lo:700: 00000004:02000040:2.0:1788969855.627584:0:7060:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788969855.633147:0:7060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7060:1875870741442432:0@lo:5: 00000100:00100000:2.0:1788969855.633217:0:7060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969855.633330:0:7060:0:(client.c:2716:ptlrpc_set_wait()) set ffff977851f953c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969855.633538:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741442432 00000100:00100000:1.0:1788969855.633548:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741442432 00000100:00100000:1.0:1788969855.633647:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788969855.633656:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7060:x1875870741442432:12345-0@lo:5: 00002000:00080000:1.0:1788969855.651063:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788969855.651088:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788969855.660313:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7060:x1875870741442432:12345-0@lo:5: Request processed in 26650us (27088us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788969855.660327:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788969855.660496:0:7060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778616d7480 x1875870741442432/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788969871 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969855.660514:0:7060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7060:1875870741442432:0@lo:5: 00000004:00080000:3.0:1788969855.660530:0:7060:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788969856.069979:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969857.105192:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969858.116964:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969859.140977:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788969860.077928:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788969860.166361:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969860.551130:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969860.551154:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741442560:0@lo:13: 00000100:00100000:0.0:1788969860.551227:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969860.551394:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741442560 00000100:00100000:3.0:1788969860.551401:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741442560 00000100:00100000:3.0:1788969860.551457:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788969860.551477:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741442560:12345-0@lo:13: 00002000:00000024:3.0:1788969860.551521:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969860.551565:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741442560:12345-0@lo:13: Request processed in 90us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969860.551572:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788969860.551733:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788969860.551759:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855cea1c0 x1875870741442560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969860.551769:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788969860.551814:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741442560:0@lo:13: 00000100:00100000:0.0:1788969860.559954:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788969860.559978:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741442688:0@lo:400: 00000100:00100000:0.0:1788969860.560048:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969860.560107:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741442688 00000100:00100000:0.0:1788969860.560115:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741442688 00000100:00100000:0.0:1788969860.560162:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788969860.560171:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:3284:x1875870741442688:12345-0@lo:400: 00000100:00100000:0.0:1788969860.560449:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:3284:x1875870741442688:12345-0@lo:400: Request processed in 278us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969860.560457:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788969860.560659:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741442944:0@lo:400: 00000100:00100000:0.0:1788969860.560688:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969860.560733:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741442944 00000100:00100000:0.0:1788969860.560738:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741442944 00000100:00100000:0.0:1788969860.560771:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788969860.560777:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741442944:12345-0@lo:400: 00000100:00100000:0.0:1788969860.560836:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741442944:12345-0@lo:400: Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969860.560842:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788969860.560860:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788969860.560886:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855c15680 x1875870741442944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969860.560899:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741442944:0@lo:400: 00000100:00100000:2.0:1788969860.560979:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741442816:0@lo:400: 00000100:00100000:2.0:1788969860.561008:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969860.561040:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741442688:0@lo:400: 00000100:00100000:0.0:1788969860.561153:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741442816 00000100:00100000:0.0:1788969860.561157:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741442816 00000100:00100000:0.0:1788969860.561191:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788969860.561197:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741442816:12345-0@lo:400: 00000100:00100000:0.0:1788969860.561375:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741442816:12345-0@lo:400: Request processed in 177us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969860.561383:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788969860.563472:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855c16580 x1875870741442816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969860.563490:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741442816:0@lo:400: 00010000:00010000:2.0:1788969861.193733:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969862.213069:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969863.237144:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969864.261076:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969865.286273:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969865.670390:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741443456:0@lo:400: 00000100:00100000:3.0:1788969865.670455:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969865.670512:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788969865.670519:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741443072:0@lo:400: 00000100:00100000:3.0:1788969865.670545:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969865.670578:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741443584:0@lo:13: 00000100:00100000:3.0:1788969865.670600:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969865.670623:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741443200:0@lo:400: 00000100:00100000:3.0:1788969865.670644:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969865.670675:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788969865.670680:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741443328:0@lo:400: 00000100:00100000:3.0:1788969865.670698:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969865.670723:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741443456 00000100:00100000:3.0:1788969865.670730:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741443456 00000100:00100000:3.0:1788969865.670779:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788969865.670808:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741443456:12345-0@lo:400: 00000100:00100000:3.0:1788969865.675886:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741443456:12345-0@lo:400: Request processed in 5089us (5420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969865.675902:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788969865.675947:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741443072 00000100:00100000:3.0:1788969865.675956:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741443072 00000100:00100000:3.0:1788969865.676047:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788969865.676056:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:3285:x1875870741443072:12345-0@lo:400: 00000100:00100000:3.0:1788969865.676122:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:3285:x1875870741443072:12345-0@lo:400: Request processed in 68us (5576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969865.676128:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788969865.676158:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741443584 00000100:00100000:3.0:1788969865.676162:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741443584 00000100:00100000:3.0:1788969865.676188:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788969865.676194:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741443584:12345-0@lo:13: 00002000:00000024:3.0:1788969865.676222:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969865.676256:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741443584:12345-0@lo:13: Request processed in 62us (5654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969865.676271:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788969865.676290:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741443200 00000100:00100000:3.0:1788969865.676294:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741443200 00000100:00100000:3.0:1788969865.676319:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741443328 00000100:00100000:3.0:1788969865.676321:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741443328 00000100:00100000:3.0:1788969865.676344:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788969865.676350:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741443200:12345-0@lo:400: 00000100:00100000:3.0:1788969865.676388:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741443200:12345-0@lo:400: Request processed in 38us (5742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969865.676394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788969865.676405:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788969865.676412:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741443328:12345-0@lo:400: 00000100:00100000:3.0:1788969865.676437:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741443328:12345-0@lo:400: Request processed in 27us (5738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969865.676443:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788969865.676461:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788969865.676465:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788969865.676517:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855ce8000 x1875870741443328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969865.676534:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741443328:0@lo:400: 00010000:00080000:3.0:1788969865.676545:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855cebc00 x1875870741443200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969865.676553:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741443200:0@lo:400: 00000100:00100000:3.0:1788969865.676587:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741443072:0@lo:400: 00010000:00080000:3.0:1788969865.676598:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977852cec000 x1875870741443584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969865.676620:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741443584:0@lo:13: 00010000:00080000:3.0:1788969865.676633:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855cea1c0 x1875870741443456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969865.676640:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741443456:0@lo:400: 00010000:00010000:1.0:1788969866.309826:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788969866.825764:0:7599:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788969866.825768:0:7599:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788969866.827072:0:7599:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97784c0a0000 00000020:01000004:0.0:1788969866.827094:0:7599:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788969866.827107:0:7599:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788969866.827121:0:7599:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff977850050000) 00000020:00000080:0.0:1788969866.827140:0:7599:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788969866.883588:0:7599:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788969866.886759:0:7599:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788969866.936089:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788969866.957728:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788969866.957758:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788969866.957838:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788969866.957861:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788969866.959603:0:7599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788969866.959617:0:7599:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788969866.959657:0:7599:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d0de860b05b39ae 00000020:01000004:2.0:1788969866.959667:0:7599:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788969866.959687:0:7599:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788969866.959690:0:7599:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788969866.959696:0:7599:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788969866.959716:0:7599:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788969866.959720:0:7599:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788969866.984558:0:7599:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788969866.984602:0:7599:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.109@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788969866.984607:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788969866.984609:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788969866.984610:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788969866.984612:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788969866.984613:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788969866.984614:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788969866.984615:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788969866.984617:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788969866.984618:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788969866.984619:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788969866.984621:0:7599:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788969866.984625:0:7599:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788969866.984627:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788969866.984629:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788969866.984630:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788969866.984631:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788969866.984632:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788969866.984633:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788969866.984634:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788969866.984635:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788969866.984636:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788969866.984637:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788969866.987833:0:7599:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788969866.988201:0:7599:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788969866.988225:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741443712:0@lo:253: 00000100:00100000:3.0:1788969866.988299:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969866.988363:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741443712 00000100:00100000:3.0:1788969866.988370:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f936c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788969866.988372:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741443712 00000100:00100000:0.0:1788969866.988424:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788969866.988433:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:7599:x1875870741443712:12345-0@lo:253: 20000000:01000000:0.0:1788969866.988462:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788969866.988467:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788969866.988472:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788969866.988476:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788969866.989557:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788969866.990034:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788969866.990053:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788969866.990099:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788969866.990108:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788969866.990198:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788969866.990311:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788969866.990700:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788969866.990719:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.109@tcp 20000000:01000000:0.0:1788969866.990721:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:0.0:1788969866.990755:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788969866.990772:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788969866.990852:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788969866.990861:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:0.0:1788969866.990893:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788969866.990903:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788969866.990937:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788969866.990989:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788969866.991879:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788969866.991900:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.109@tcp 20000000:01000000:0.0:1788969866.991902:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.109@tcp (null) (null) (null) 00000040:00080000:0.0:1788969866.991938:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788969866.991947:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788969866.991979:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788969866.991987:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.109@tcp (null) (null) 00000040:00080000:0.0:1788969866.992018:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788969866.992027:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788969866.992072:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788969866.992108:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788969866.992125:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788969866.992128:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788969866.992132:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788969866.992159:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788969866.992162:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788969866.992197:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788969866.992200:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788969866.997338:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788969866.997429:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788969866.997489:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788969866.998308:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788969866.998349:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788969866.998415:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788969866.998429:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788969866.998432:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788969866.999127:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788969866.999501:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788969866.999544:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788969866.999605:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788969866.999619:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788969866.999621:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788969867.000315:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788969867.000382:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788969867.000439:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788969867.000740:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788969867.000920:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788969867.000964:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788969867.000980:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788969867.000982:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788969867.001957:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788969867.002037:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788969867.002075:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788969867.002518:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788969867.002562:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788969867.002617:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788969867.002634:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788969867.002637:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788969867.002656:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788969867.002678:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.002697:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b38ff expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.002705:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3929 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.002712:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3953 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.002719:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b396f expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.002727:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3999 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.002743:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.002782:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3999 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.005939:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3999 expref: 16 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.005962:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741443840:0@lo:104: 00000100:00100000:3.0:1788969867.006072:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788969867.006197:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b396f expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.006416:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b396f expref: 16 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.006427:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cee580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741443968:0@lo:104: 00010000:00010000:3.0:1788969867.006457:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3953 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.006464:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3953 expref: 16 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.006472:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ceda40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741444096:0@lo:104: 00010000:00010000:3.0:1788969867.006492:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3929 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.006500:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3929 expref: 16 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.006523:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741444224:0@lo:104: 00010000:00010000:3.0:1788969867.006544:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b38ff expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.006551:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b38ff expref: 16 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.006559:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741444352:0@lo:104: 00000100:00100000:3.0:1788969867.006574:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f9369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969867.006693:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788969867.006711:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969867.006782:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969867.006975:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969867.006996:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741443840 00000100:00100000:0.0:1788969867.007003:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741443840 00000100:00100000:0.0:1788969867.007040:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741443968 00000100:00100000:0.0:1788969867.007043:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741443968 00000100:00100000:0.0:1788969867.007053:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741444096 00000100:00100000:0.0:1788969867.007055:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741444096 00000100:00100000:0.0:1788969867.007067:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788969867.007082:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97786017f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:5826:x1875870741443840:12345-0@lo:104: 00010000:00010000:0.0:1788969867.007096:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969867.007367:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969867.007377:0:5815:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788969867.007383:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1788969867.007510:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741444224 00000100:00100000:1.0:1788969867.007514:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741444224 00000100:00100000:1.0:1788969867.007531:0:5815:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788969867.007536:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741444352 00000100:00100000:1.0:1788969867.007539:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741444352 00000100:00100000:1.0:1788969867.007605:0:7605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788969867.007612:0:7605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+7:5826:x1875870741443968:12345-0@lo:104: 00010000:00010000:1.0:1788969867.007620:0:7605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969867.007699:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788969867.007706:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97786017f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+7:5826:x1875870741443840:12345-0@lo:104: Request processed in 626us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969867.007713:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788969867.007761:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788969867.007768:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+6:5826:x1875870741444096:12345-0@lo:104: 00010000:00010000:0.0:1788969867.007776:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.007854:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788969867.007861:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.007868:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5800 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788969867.007873:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.007881:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788969867.007888:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788969867.007894:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788969867.007927:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.007934:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788969867.007953:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.007968:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39a0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.007982:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788969867.007985:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.007990:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841544a00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788969867.007993:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008000:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788969867.008006:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788969867.008011:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788969867.008025:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008030:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788969867.008036:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008042:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841544a00/0x5d0de860b05b396f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3976 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008052:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788969867.008060:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008066:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841544400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788969867.008069:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008075:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788969867.008081:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788969867.008086:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788969867.008099:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008105:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788969867.008119:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008126:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841544400/0x5d0de860b05b3953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b395a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008135:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969867.008137:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969867.008139:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969867.008166:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741444480:0@lo:103: 00000100:00100000:2.0:1788969867.008202:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.008245:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969867.008252:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741444608:0@lo:103: 00000100:00100000:2.0:1788969867.008291:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.008318:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741444736:0@lo:103: 00000100:00100000:2.0:1788969867.008337:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.008379:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741444480 00000100:00100000:2.0:1788969867.008384:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741444480 00010000:00010000:2.0:1788969867.008403:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3999 expref: 17 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.008417:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741444608 00000100:00100000:2.0:1788969867.008419:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741444608 00010000:00010000:2.0:1788969867.008428:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b396f expref: 18 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.008437:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741444736 00000100:00100000:2.0:1788969867.008439:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741444736 00010000:00010000:2.0:1788969867.008448:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3953 expref: 19 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.008459:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788969867.008464:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741444480:12345-0@lo:103: 00010000:00010000:2.0:1788969867.008474:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788969867.008479:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3999 expref: 19 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008488:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3999 expref: 19 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008504:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969867.008533:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741444480:12345-0@lo:103: Request processed in 68us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.008548:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788969867.008563:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788969867.008568:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a32940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3283:x1875870741444608:12345-0@lo:103: 00010000:00010000:2.0:1788969867.008576:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788969867.008581:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b396f expref: 18 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008590:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b396f expref: 18 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008598:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969867.008618:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a32940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3283:x1875870741444608:12345-0@lo:103: Request processed in 51us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.008624:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788969867.008634:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788969867.008654:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:3285:x1875870741444736:12345-0@lo:103: 00010000:00010000:2.0:1788969867.008661:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788969867.008665:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3953 expref: 17 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008674:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3953 expref: 17 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.008684:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969867.008706:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:3285:x1875870741444736:12345-0@lo:103: Request processed in 67us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.008713:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788969867.008748:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741444736:0@lo:103: 00000100:00100000:2.0:1788969867.008780:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741444608:0@lo:103: 00000100:00100000:2.0:1788969867.008813:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a31e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741444480:0@lo:103: 00010000:00010000:3.0:1788969867.009338:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b39a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3999 expref: 16 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.009356:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741443840:0@lo:104: 00010000:00010000:3.0:1788969867.009368:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841544600/0x5d0de860b05b3976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b396f expref: 15 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.009375:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cee580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741443968:0@lo:104: 00010000:00010000:3.0:1788969867.009383:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b395a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3953 expref: 14 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.009393:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ceda40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741444096:0@lo:104: 00010000:00010000:1.0:1788969867.009504:0:7605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788969867.009513:0:7605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+6:5826:x1875870741443968:12345-0@lo:104: Request processed in 1901us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.009520:0:7605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788969867.009544:0:7605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788969867.009559:0:7605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:5826:x1875870741444224:12345-0@lo:104: 00010000:00010000:1.0:1788969867.009570:0:7605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.009629:0:7605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788969867.009635:0:7605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:5826:x1875870741444224:12345-0@lo:104: Request processed in 85us (2660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.009651:0:7605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788969867.009667:0:7605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788969867.009674:0:7605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:5826:x1875870741444352:12345-0@lo:104: 00010000:00010000:1.0:1788969867.009682:0:7605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.009709:0:7605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788969867.009714:0:7605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:5826:x1875870741444352:12345-0@lo:104: Request processed in 41us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.009719:0:7605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788969867.009938:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788969867.009944:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.009951:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788969867.009955:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.009971:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788969867.009978:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969867.009983:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788969867.010019:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.010025:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788969867.010040:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.010046:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff4e00/0x5d0de860b05b3929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3930 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.010059:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788969867.010063:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.010068:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788969867.010070:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.010076:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788969867.010081:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969867.010092:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788969867.010105:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.010111:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788969867.010120:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.010127:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b38ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3906 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.010151:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969867.010153:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969867.010155:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969867.010169:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741444864:0@lo:103: 00000100:00100000:3.0:1788969867.010202:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969867.010265:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741444224:0@lo:104: 00000100:00100000:3.0:1788969867.010273:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875870741444352:0@lo:104: 00010000:00010000:3.0:1788969867.010294:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.010676:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788969867.010688:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741444992:0@lo:103: 00000100:00100000:2.0:1788969867.010718:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788969867.010763:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969867.010773:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741444864 00000100:00100000:2.0:1788969867.010779:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741444864 00010000:00010000:2.0:1788969867.010832:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3929 expref: 14 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.010855:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741444992 00000100:00100000:2.0:1788969867.010858:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741444992 00010000:00010000:2.0:1788969867.010870:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b38ff expref: 15 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.010883:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788969867.010889:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:3286:x1875870741444864:12345-0@lo:103: 00010000:00010000:2.0:1788969867.010899:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788969867.010904:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3929 expref: 15 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.010915:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3929 expref: 15 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.010927:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dc000/0x5d0de860b05b3930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3929 expref: 15 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.010939:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969867.010977:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3286:x1875870741444864:12345-0@lo:103: Request processed in 88us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.010984:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788969867.010998:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788969867.011004:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a31e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:3284:x1875870741444992:12345-0@lo:103: 00010000:00010000:2.0:1788969867.011011:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788969867.011016:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b38ff expref: 13 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011024:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b38ff expref: 13 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011034:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dd600/0x5d0de860b05b3906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b38ff expref: 13 pid: 5826 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011046:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011055:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011069:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011077:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011085:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011091:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011103:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788969867.011108:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011117:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011129:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.011154:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969867.011185:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a31e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3284:x1875870741444992:12345-0@lo:103: Request processed in 181us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.011192:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788969867.011301:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741444864:0@lo:103: 00000100:00100000:2.0:1788969867.011323:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741444992:0@lo:103: 00010000:00010000:3.0:1788969867.011663:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.011672:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.011678:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841545400/0x5d0de860b05b39b5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788969867.011699:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1788969867.017218:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788969867.017238:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5826:x1875870741444096:12345-0@lo:104: Request processed in 9464us (10449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969867.017251:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788969867.018548:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969867.047583:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:7599:x1875870741443712:12345-0@lo:253: Request processed in 59143us (59275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.047596:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788969867.047698:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741443712:0@lo:253: 10000000:01000000:3.0:1788969867.047711:0:7599:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788969867.047714:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788969867.047715:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788969867.047716:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788969867.047718:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788969867.047719:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788969867.047720:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788969867.047721:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788969867.047723:0:7599:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788969867.047724:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788969867.047725:0:7599:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788969867.047746:0:7599:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97784c0a0000 from lustre-OST0001 10000000:01000000:3.0:1788969867.047768:0:7599:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788969867.047770:0:7599:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788969867.047777:0:7599:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9778652a99c0 local copy 10000000:01000000:3.0:1788969867.047781:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788969867.047839:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.047849:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.047859:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.047874:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445120:0@lo:101: 00000100:00100000:3.0:1788969867.047909:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969867.047944:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f936300 going to sleep for 11 seconds 00000100:00100000:1.0:1788969867.048026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741445120 00000100:00100000:1.0:1788969867.048032:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741445120 00000100:00100000:1.0:1788969867.048070:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788969867.048078:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:7599:x1875870741445120:12345-0@lo:101: 00010000:00010000:1.0:1788969867.048089:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969867.048101:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b39c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b39bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.048123:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b39c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b39bc expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.048162:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b39c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b39bc expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.048170:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9e00, rc 0) 00000100:00100000:1.0:1788969867.048199:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445120:12345-0@lo:101: Request processed in 123us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.048215:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788969867.048407:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445120:0@lo:101: 00010000:00010000:2.0:1788969867.048421:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.048429:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.048519:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445248:0@lo:501: 00000100:00100000:2.0:1788969867.048547:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.048574:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32900 going to sleep for 11 seconds 00000100:00100000:3.0:1788969867.048647:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741445248 00000100:00100000:3.0:1788969867.048657:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741445248 00000100:00100000:3.0:1788969867.048689:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788969867.048696:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445248:12345-0@lo:501: 00000100:00100000:3.0:1788969867.048897:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445248:12345-0@lo:501: Request processed in 201us (348us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788969867.048904:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788969867.048979:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445248:0@lo:501: 10000000:01000000:2.0:1788969867.048990:0:7599:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788969867.049016:0:7599:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788969867.049021:0:7599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.049028:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.049035:0:7599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.049056:0:7599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788969867.049075:0:7599:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97784c0a0000 10000000:01000000:2.0:1788969867.049079:0:7599:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788969867.049084:0:7599:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788969867.049086:0:7599:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788969867.049090:0:7599:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788969867.049093:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788969867.049106:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.049113:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.049120:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.049132:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445376:0@lo:101: 00000100:00100000:2.0:1788969867.049170:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.049195:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32e40 going to sleep for 11 seconds 00010000:00010000:3.0:1788969867.049370:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788969867.049377:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.049384:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788969867.049388:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.049396:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788969867.049404:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969867.049410:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788969867.049427:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.049434:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788969867.049460:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.049468:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d0de860b05b39c3 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.049494:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969867.049495:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969867.049497:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969867.049505:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788969867.049516:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741445504:0@lo:103: 00000100:00100000:3.0:1788969867.049544:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969867.049577:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741445504 00000100:00100000:3.0:1788969867.049582:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741445504 00000100:00100000:3.0:1788969867.049611:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788969867.049618:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3283:x1875870741445504:12345-0@lo:103: 00010000:00010000:3.0:1788969867.049627:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969867.049649:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b39c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b39bc expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.049664:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788969867.049692:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:3283:x1875870741445504:12345-0@lo:103: Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.049699:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788969867.049727:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741445504:0@lo:103: 00000100:00100000:3.0:1788969867.049742:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741445376 00000100:00100000:3.0:1788969867.049746:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741445376 00000100:00100000:3.0:1788969867.049765:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788969867.049771:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+11:7599:x1875870741445376:12345-0@lo:101: 00010000:00010000:3.0:1788969867.049779:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969867.049828:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b39ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.049857:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b39ca expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.049867:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b39ca expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.049874:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841544600, rc 0) 00000100:00100000:3.0:1788969867.049900:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445376:12345-0@lo:101: Request processed in 129us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.049906:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788969867.049991:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445376:0@lo:101: 00010000:00010000:2.0:1788969867.050003:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.050011:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.050076:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445632:0@lo:501: 00000100:00100000:2.0:1788969867.050102:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.050129:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788969867.050311:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741445632 00000100:00100000:3.0:1788969867.050315:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741445632 00000100:00100000:3.0:1788969867.050348:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788969867.050354:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445632:12345-0@lo:501: 00000100:00100000:3.0:1788969867.050532:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445632:12345-0@lo:501: Request processed in 177us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.050539:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788969867.050676:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445632:0@lo:501: 00000100:00100000:2.0:1788969867.050704:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445760:0@lo:503: 00000100:00100000:2.0:1788969867.050743:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.050767:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788969867.050908:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741445760 00000100:00100000:3.0:1788969867.050912:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741445760 00000100:00100000:3.0:1788969867.050979:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788969867.050986:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445760:12345-0@lo:503: 00000100:00100000:3.0:1788969867.051136:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445760:12345-0@lo:503: Request processed in 151us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.051153:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788969867.051232:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445760:0@lo:503: 00000040:00080000:2.0:1788969867.051489:0:7599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788969867.051562:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445888:0@lo:502: 00000100:00100000:2.0:1788969867.051603:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.052133:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788969867.052307:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741445888 00000100:00100000:1.0:1788969867.052314:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741445888 00000100:00100000:1.0:1788969867.052361:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788969867.052369:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445888:12345-0@lo:502: 00000100:00100000:1.0:1788969867.052559:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741445888:12345-0@lo:502: Request processed in 190us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.052566:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788969867.052666:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741445888:0@lo:502: 00000040:00080000:2.0:1788969867.052968:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788969867.053021:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788969867.053053:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788969867.053098:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788969867.053132:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788969867.053180:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788969867.053294:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446016:0@lo:502: 00000100:00100000:2.0:1788969867.053337:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.053359:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788969867.053513:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741446016 00000100:00100000:1.0:1788969867.053519:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741446016 00000100:00100000:1.0:1788969867.053543:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788969867.053551:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741446016:12345-0@lo:502: 00000100:00100000:1.0:1788969867.053704:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741446016:12345-0@lo:502: Request processed in 152us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.053711:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788969867.053953:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446016:0@lo:502: 00000040:00080000:2.0:1788969867.054061:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788969867.054072:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788969867.054897:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788969867.054907:0:7606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788969867.054966:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788969867.054969:0:7606:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788969867.054976:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788969867.054994:0:7606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9778650eb380) 00000020:00000080:3.0:1788969867.055016:0:7606:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788969867.055021:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788969867.055072:0:7606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97784c0a0000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788969867.055079:0:7606:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788969867.055084:0:7606:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d0de860b05b39df 00010000:00010000:3.0:1788969867.058610:0:7606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788969867.059111:0:7606:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788969867.061852:0:7606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788969867.062118:0:7606:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788969867.066842:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788969867.067321:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788969867.068834:0:7606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788969867.068847:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788969867.068854:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969867.068862:0:7606:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788969867.068866:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788969867.068871:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969867.068872:0:7606:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788969867.068875:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788969867.068877:0:7606:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788969867.068926:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788969867.068930:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969867.068931:0:7606:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788969867.068934:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788969867.069108:0:7599:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788969867.069132:0:7599:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788969867.069162:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.069173:0:7599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969867.069181:0:7599:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97784c0a0000 from 1 10000000:01000000:3.0:1788969867.069184:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788969867.069224:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.069231:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.069242:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.069262:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446144:0@lo:101: 00000100:00100000:3.0:1788969867.069321:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969867.069361:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f936900 going to sleep for 11 seconds 00000100:00100000:0.0:1788969867.069552:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741446144 00000100:00100000:0.0:1788969867.069560:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741446144 00000100:00100000:0.0:1788969867.069601:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788969867.069609:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:7599:x1875870741446144:12345-0@lo:101: 00010000:00010000:0.0:1788969867.069622:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969867.069633:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b39e6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969867.069666:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b39e6 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969867.069689:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b39e6 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969867.069697:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5a00, rc 0) 00000100:00100000:0.0:1788969867.069738:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446144:12345-0@lo:101: Request processed in 130us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969867.069745:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788969867.069818:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446144:0@lo:101: 00010000:00010000:0.0:1788969867.069833:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969867.069842:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969867.069922:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446272:0@lo:501: 00000100:00100000:0.0:1788969867.069948:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969867.069965:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847233c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788969867.070041:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741446272 00000100:00100000:1.0:1788969867.070045:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741446272 00000100:00100000:1.0:1788969867.070076:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788969867.070083:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446272:12345-0@lo:501: 00000100:00100000:1.0:1788969867.070408:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446272:12345-0@lo:501: Request processed in 325us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.070415:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788969867.070595:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446272:0@lo:501: 00000100:00100000:0.0:1788969867.070622:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446400:0@lo:503: 00000100:00100000:0.0:1788969867.070670:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969867.070690:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847233c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788969867.070703:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741446400 00000100:00100000:0.0:1788969867.070706:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741446400 00000100:00100000:0.0:1788969867.070732:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788969867.070737:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446400:12345-0@lo:503: 00000100:00100000:0.0:1788969867.071022:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446400:12345-0@lo:503: Request processed in 284us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969867.071034:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788969867.071073:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446400:0@lo:503: 00000040:00080000:0.0:1788969867.071505:0:7599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788969867.071574:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446528:0@lo:502: 00000100:00100000:0.0:1788969867.071608:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969867.071651:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847233c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788969867.071708:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741446528 00000100:00100000:3.0:1788969867.071712:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741446528 00000100:00100000:3.0:1788969867.071743:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788969867.071750:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446528:12345-0@lo:502: 00000100:00100000:3.0:1788969867.071934:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446528:12345-0@lo:502: Request processed in 184us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.071941:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788969867.072911:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446528:0@lo:502: 00000040:00080000:0.0:1788969867.074324:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788969867.074402:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788969867.074442:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446656:0@lo:502: 00000100:00100000:0.0:1788969867.074504:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969867.074673:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847233c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788969867.076123:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741446656 00000100:00100000:3.0:1788969867.076134:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741446656 00000100:00100000:3.0:1788969867.076302:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788969867.076312:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446656:12345-0@lo:502: 00000100:00100000:3.0:1788969867.076558:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446656:12345-0@lo:502: Request processed in 247us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.076567:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788969867.077341:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446656:0@lo:502: 00000040:00080000:2.0:1788969867.077505:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788969867.077520:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788969867.078452:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788969867.078464:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969867.078466:0:7610:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788969867.078472:0:7610:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97784c0a0000 00000020:00000080:1.0:1788969867.078475:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788969867.078495:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788969867.078498:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969867.078500:0:7610:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788969867.078503:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788969867.078636:0:7599:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788969867.078668:0:7599:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788969867.078689:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.078701:0:7599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788969867.078743:0:7599:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788969867.078746:0:7599:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97784c0a0000 10000000:01000000:2.0:1788969867.078749:0:7599:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97784c0a0000 10000000:01000000:2.0:1788969867.078754:0:7599:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788969867.078760:0:7599:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97784c0a0000 from 1 10000000:01000000:2.0:1788969867.078762:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788969867.078817:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.078827:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.078850:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.078871:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446784:0@lo:101: 00000100:00100000:2.0:1788969867.078927:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.078970:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969867.079030:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741446784 00000100:00100000:3.0:1788969867.079036:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741446784 00000100:00100000:3.0:1788969867.079082:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788969867.079092:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741446784:12345-0@lo:101: 00010000:00010000:3.0:1788969867.079104:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969867.079118:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b39f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.079150:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b39f4 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.079162:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b39f4 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969867.079179:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841545600, rc 0) 00000100:00100000:3.0:1788969867.079381:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741446784:12345-0@lo:101: Request processed in 290us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.079388:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788969867.079469:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446784:0@lo:101: 00010000:00010000:2.0:1788969867.079482:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.079490:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969867.079566:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446912:0@lo:501: 00000100:00100000:2.0:1788969867.079592:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.079623:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969867.079730:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741446912 00000100:00100000:3.0:1788969867.079735:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741446912 00000100:00100000:3.0:1788969867.079766:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788969867.079774:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741446912:12345-0@lo:501: 00000100:00100000:3.0:1788969867.080017:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741446912:12345-0@lo:501: Request processed in 242us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.080024:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788969867.080114:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741446912:0@lo:501: 00000100:00100000:1.0:1788969867.080151:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741447040:0@lo:503: 00000100:00100000:1.0:1788969867.080190:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969867.080217:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2eec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788969867.080378:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741447040 00000100:00100000:2.0:1788969867.080383:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741447040 00000100:00100000:2.0:1788969867.080416:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788969867.080423:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741447040:12345-0@lo:503: 00000100:00100000:2.0:1788969867.080560:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741447040:12345-0@lo:503: Request processed in 138us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.080567:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788969867.080606:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741447040:0@lo:503: 00000040:00080000:2.0:1788969867.080876:0:7599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788969867.080932:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a33c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741447168:0@lo:502: 00000100:00100000:2.0:1788969867.080972:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.080988:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32840 going to sleep for 11 seconds 00000100:00100000:2.0:1788969867.081001:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741447168 00000100:00100000:2.0:1788969867.081005:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741447168 00000100:00100000:2.0:1788969867.081022:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788969867.081028:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741447168:12345-0@lo:502: 00000100:00100000:2.0:1788969867.081515:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741447168:12345-0@lo:502: Request processed in 486us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.081522:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788969867.081581:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a33c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741447168:0@lo:502: 00000040:00080000:1.0:1788969867.081920:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788969867.081973:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788969867.082007:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788969867.082054:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788969867.082092:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788969867.082271:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788969867.082312:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788969867.082345:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788969867.082415:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788969867.082454:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788969867.082490:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788969867.082541:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788969867.082579:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788969867.082614:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788969867.082677:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788969867.082716:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788969867.082748:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788969867.082977:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788969867.083019:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788969867.083054:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788969867.083105:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788969867.083157:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788969867.083194:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788969867.083390:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788969867.083425:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788969867.083459:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788969867.083509:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788969867.083546:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788969867.083579:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788969867.083721:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788969867.083774:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788969867.085466:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788969867.085533:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788969867.085603:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788969867.085654:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788969867.085698:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788969867.085727:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788969867.085773:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741447296:0@lo:502: 00000100:00100000:1.0:1788969867.086685:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969867.086733:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2ee840 going to sleep for 11 seconds 00000100:00100000:3.0:1788969867.086826:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741447296 00000100:00100000:3.0:1788969867.086834:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741447296 00000100:00100000:3.0:1788969867.086881:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788969867.086891:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741447296:12345-0@lo:502: 00000100:00100000:3.0:1788969867.087130:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741447296:12345-0@lo:502: Request processed in 239us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.087138:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788969867.087473:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741447296:0@lo:502: 00000040:00080000:0.0:1788969867.087575:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788969867.087591:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788969867.091407:0:7611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788969867.091433:0:7611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9778792199c0) 00000020:00000080:0.0:1788969867.091455:0:7611:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788969867.091525:0:7611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97784c0a0000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788969867.091530:0:7611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97784c0a0000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788969867.091532:0:7611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97784c0a0000 3 00010000:00080000:0.0:1788969867.091561:0:7611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9778792c8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788969867.093692:0:7611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788969867.094404:0:7611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788969867.094445:0:7611:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788969867.094458:0:7611:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d0de860b05b3a09 00000100:00080000:3.0:1788969867.094468:0:7611:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788969867.094480:0:7611:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9778792c8000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1788969867.094533:0:7611:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff977852ceda40 x1875870741447424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788969867.094597:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741447424:0@lo:38: 00000100:00100000:0.0:1788969867.094675:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788969867.094735:0:7611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788969867.094845:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741447808:0@lo:400: 00000100:00100000:3.0:1788969867.094876:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.095038:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741447552:0@lo:400: 00000100:00100000:2.0:1788969867.095068:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.095094:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788969867.095099:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741447680:0@lo:400: 00000100:00100000:2.0:1788969867.095121:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969867.095169:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741447424 00000100:00100000:2.0:1788969867.095176:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741447424 00000100:00100000:2.0:1788969867.095273:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741447552 00000100:00100000:2.0:1788969867.095277:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741447552 00000100:00100000:2.0:1788969867.095314:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741447680 00000100:00100000:2.0:1788969867.095318:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741447680 00000100:00100000:2.0:1788969867.095345:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788969867.095353:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741447552:12345-0@lo:400: 00000100:00100000:2.0:1788969867.095401:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741447552:12345-0@lo:400: Request processed in 49us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.095408:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788969867.095424:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788969867.095431:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741447680:12345-0@lo:400: 00000100:00100000:2.0:1788969867.095458:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741447680:12345-0@lo:400: Request processed in 28us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.095471:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788969867.095484:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788969867.095488:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875870741447424:12345-0@lo:38: 00010000:00080000:2.0:1788969867.095506:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:2.0:1788969867.095532:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d0de860b05b3a10 00000004:00100000:2.0:1788969867.095547:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788969867.095575:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97787f49b000 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1788969867.098177:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788969867.098243:0:7599:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788969867.098266:0:7599:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788969867.098282:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.098294:0:7599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788969867.098340:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788969867.098342:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788969867.098344:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788969867.098345:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788969867.098346:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788969867.098347:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788969867.098349:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788969867.098350:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788969867.098352:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788969867.098353:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788969867.098355:0:7599:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788969867.098358:0:7599:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788969867.098361:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788969867.098362:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788969867.098363:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788969867.098364:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788969867.098365:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788969867.098371:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788969867.098372:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788969867.098373:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788969867.098374:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788969867.098375:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788969867.098376:0:7599:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788969867.098400:0:7599:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788969867.098419:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741447936:0@lo:253: 00000100:00100000:1.0:1788969867.098483:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969867.098516:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2eee40 going to sleep for 11 seconds 00000100:00080000:3.0:1788969867.098852:0:7612:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff977852cec780 x1875870741448064/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969867.098861:0:7612:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778536199c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788969867.098964:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875870741447424:12345-0@lo:38: Request processed in 3472us (4287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.098974:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788969867.099004:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788969867.099036:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977852cef840 x1875870741447680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969867.099050:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741447680:0@lo:400: 00010000:00080000:2.0:1788969867.099064:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977852cee580 x1875870741447552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969867.099072:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741447552:0@lo:400: 00000100:00100000:2.0:1788969867.099106:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741447936 00000100:00100000:2.0:1788969867.099112:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741447936 00000100:00100000:2.0:1788969867.099157:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788969867.099166:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:7599:x1875870741447936:12345-0@lo:253: 20000000:01000000:2.0:1788969867.099188:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788969867.099302:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788969867.102372:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741447808 00000100:00100000:1.0:1788969867.102387:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741447808 00000100:00100000:1.0:1788969867.102464:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788969867.102474:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741447808:12345-0@lo:400: 00000100:00100000:1.0:1788969867.102564:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741447808:12345-0@lo:400: Request processed in 91us (7685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.102570:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788969867.102691:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977852ceda40 x1875870741447424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788969877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969867.102710:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788969867.102721:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788969867.102729:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788969867.102734:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788969867.102737:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788969867.102744:0:3282:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000758062c0): req@ffff977852cec780 x1875870741448064/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969867.102762:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741447424:0@lo:38: 00010000:00080000:0.0:1788969867.103012:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977852ceed00 x1875870741447808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969867.103022:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741447808:0@lo:400: 00000100:00100000:0.0:1788969867.103081:0:7612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969867.103118:0:7612:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778536199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969867.103171:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741448064 00000100:00100000:1.0:1788969867.103176:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741448064 00000100:00100000:1.0:1788969867.103222:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788969867.103229:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7612:x1875870741448064:12345-0@lo:901: 00000100:00100000:1.0:1788969867.103577:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7612:x1875870741448064:12345-0@lo:901: Request processed in 348us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.103584:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788969867.103730:0:7612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977852cec780 x1875870741448064/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788969883 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969867.103739:0:7612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec780 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7612:1875870741448064:0@lo:901: 00000100:00080000:2.0:1788969867.104059:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788969867.104064:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 20000000:01000000:2.0:1788969867.127594:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788969867.127613:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788969867.128775:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788969867.128783:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788969867.128824:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.128843:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3961 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.128874:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.128911:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3961 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.128926:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3961 expref: 14 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969867.128940:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875870741448192:0@lo:104: 00000100:00100000:1.0:1788969867.129002:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969867.129051:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2ee840 going to sleep for 11 seconds 00000100:00100000:2.0:1788969867.129119:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741448192 00000100:00100000:2.0:1788969867.129127:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741448192 00000100:00100000:2.0:1788969867.129187:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788969867.129196:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5848:x1875870741448192:12345-0@lo:104: 00010000:00010000:2.0:1788969867.129219:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969867.129272:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788969867.129278:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:5848:x1875870741448192:12345-0@lo:104: Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969867.129285:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788969867.129425:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875870741448192:0@lo:104: 00010000:00010000:1.0:1788969867.129443:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.129925:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788969867.129933:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.129941:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788969867.129945:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.129954:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788969867.129961:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969867.129977:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788969867.130010:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130017:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788969867.130041:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130048:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3968 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130064:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969867.130065:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969867.130067:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969867.130074:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788969867.130086:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741448320:0@lo:103: 00000100:00100000:1.0:1788969867.130123:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969867.130170:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741448320 00000100:00100000:1.0:1788969867.130175:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741448320 00010000:00010000:1.0:1788969867.130191:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3961 expref: 15 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969867.130348:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788969867.130357:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778600e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:3283:x1875870741448320:12345-0@lo:103: 00010000:00010000:1.0:1788969867.130371:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969867.130376:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3961 expref: 15 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130385:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3961 expref: 15 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130405:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3961 expref: 15 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130421:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130428:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788969867.130442:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001659105s 00010000:00010000:1.0:1788969867.130446:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130453:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130460:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130466:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130472:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788969867.130475:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130482:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130496:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.130517:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969867.130549:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778600e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3283:x1875870741448320:12345-0@lo:103: Request processed in 193us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969867.130556:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788969867.131625:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741448320:0@lo:103: 00010000:00010000:1.0:1788969867.131664:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.131673:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969867.131680:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9600/0x5d0de860b05b3a17 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969867.136665:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:7599:x1875870741447936:12345-0@lo:253: Request processed in 37492us (38174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969867.136679:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788969867.136766:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d87485c-d221-41b3-b6c0-56f4dfc97796:7599:1875870741447936:0@lo:253: 10000000:01000000:1.0:1788969867.136781:0:7599:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788969867.136784:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788969867.136786:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788969867.136879:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788969867.136881:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788969867.136882:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788969867.136883:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788969867.136885:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788969867.136886:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788969867.136887:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788969867.136889:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788969867.136890:0:7599:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788969867.136904:0:7599:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788969867.141403:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788969867.141569:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788969867.142009:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788969867.142279:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788969867.142481:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788969867.142719:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788969867.144550:0:7599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788969867.337811:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788969867.385522:0:7599:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788969867.385530:0:7599:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788969867.385563:0:7599:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788969867.385619:0:7599:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788969867.385645:0:7599:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788969867.385671:0:7599:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788969868.362099:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969869.381755:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969870.408160:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969870.789193:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741448448:0@lo:13: 00000100:00100000:0.0:1788969870.789259:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969870.789388:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741448448 00000100:00100000:3.0:1788969870.789397:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741448448 00000100:00100000:3.0:1788969870.789465:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788969870.789475:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741448448:12345-0@lo:13: 00002000:00000024:3.0:1788969870.789509:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969870.789554:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741448448:12345-0@lo:13: Request processed in 81us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969870.789561:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788969870.789598:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cecf00 x1875870741448448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969870.789628:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741448448:0@lo:13: 00000100:00080000:0.0:1788969870.789752:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788969871.436023:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969872.325322:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741448576:0@lo:400: 00000100:00100000:2.0:1788969872.325460:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969872.325504:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741449088:0@lo:400: 00000100:00100000:2.0:1788969872.325535:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969872.325561:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788969872.325567:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741448960:0@lo:400: 00000100:00100000:2.0:1788969872.325599:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969872.325628:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741448704:0@lo:400: 00000100:00100000:2.0:1788969872.325648:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969872.325665:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969872.325669:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741448832:0@lo:400: 00000100:00100000:2.0:1788969872.325687:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969872.325823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741449088 00000100:00100000:2.0:1788969872.325831:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741449088 00000100:00100000:2.0:1788969872.325880:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741448704 00000100:00100000:2.0:1788969872.325883:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741448704 00000100:00100000:2.0:1788969872.325895:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741448832 00000100:00100000:2.0:1788969872.325897:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741448832 00000100:00100000:2.0:1788969872.325912:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788969872.325919:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741449088:12345-0@lo:400: 00000100:00100000:2.0:1788969872.325965:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741449088:12345-0@lo:400: Request processed in 46us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969872.325972:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788969872.325989:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788969872.325995:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741448704:12345-0@lo:400: 00000100:00100000:2.0:1788969872.326023:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741448704:12345-0@lo:400: Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969872.326029:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788969872.326040:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788969872.326045:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741448832:12345-0@lo:400: 00000100:00100000:2.0:1788969872.326070:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741448832:12345-0@lo:400: Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969872.326076:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788969872.326094:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741448960 00000100:00100000:2.0:1788969872.326098:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741448960 00000100:00100000:2.0:1788969872.326124:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788969872.326131:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741448960:12345-0@lo:400: 00000100:00100000:2.0:1788969872.326159:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741448960:12345-0@lo:400: Request processed in 29us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969872.326164:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788969872.326207:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878a33840 x1875870741448832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969872.326221:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741448832:0@lo:400: 00010000:00080000:2.0:1788969872.326231:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878a31a40 x1875870741448704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969872.326238:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741448704:0@lo:400: 00010000:00080000:2.0:1788969872.326262:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878a30000 x1875870741448960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969872.326269:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741448960:0@lo:400: 00010000:00080000:2.0:1788969872.326278:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878a32940 x1875870741449088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969872.326284:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741449088:0@lo:400: 00000100:00100000:1.0:1788969872.326444:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741448576 00000100:00100000:1.0:1788969872.326450:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741448576 00000100:00100000:1.0:1788969872.326477:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788969872.326483:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:3286:x1875870741448576:12345-0@lo:400: 00000100:00100000:1.0:1788969872.326518:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:3286:x1875870741448576:12345-0@lo:400: Request processed in 35us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969872.326523:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788969872.328690:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741448576:0@lo:400: 00000100:00080000:0.0:1788969872.330354:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788969872.330363:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788969872.453464:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788969872.711217:0:7954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788969873.476909:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969874.501108:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969875.527237:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969875.909466:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788969875.909488:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741449216:0@lo:13: 00000100:00100000:3.0:1788969875.909567:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969875.909623:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741449216 00000100:00100000:3.0:1788969875.909631:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741449216 00000100:00100000:3.0:1788969875.909679:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788969875.909687:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741449216:12345-0@lo:13: 00002000:00000024:3.0:1788969875.909733:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969875.909892:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741449216:12345-0@lo:13: Request processed in 206us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969875.909900:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788969875.909921:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788969875.909977:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cecf00 x1875870741449216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969875.909996:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741449216:0@lo:13: 00010000:00010000:1.0:1788969876.549934:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788969876.932897:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788969876.932905:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9778601fa800 from 30 10000000:01000000:2.0:1788969876.932911:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788969876.932955:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.932967:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.932978:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969876.933014:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741449344:0@lo:101: 00000100:00100000:2.0:1788969876.933214:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.933267:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850bb0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788969876.933327:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741449344 00000100:00100000:3.0:1788969876.933336:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741449344 00000100:00100000:3.0:1788969876.933394:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788969876.933403:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741449344:12345-0@lo:101: 00010000:00010000:3.0:1788969876.933416:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969876.933430:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3a1e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969876.933453:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3a1e expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969876.933463:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a1e expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969876.933472:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841545000, rc 0) 00000100:00100000:3.0:1788969876.933520:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741449344:12345-0@lo:101: Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969876.933527:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788969876.933706:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741449344:0@lo:101: 00010000:00010000:2.0:1788969876.933719:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.933728:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969876.933777:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741449472:0@lo:501: 00000100:00100000:2.0:1788969876.933841:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.933856:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850bb0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788969876.933956:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741449472 00000100:00100000:1.0:1788969876.933961:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741449472 00000100:00100000:1.0:1788969876.933985:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788969876.933991:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741449472:12345-0@lo:501: 00000100:00100000:1.0:1788969876.934343:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741449472:12345-0@lo:501: Request processed in 352us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969876.934350:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788969876.934652:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741449472:0@lo:501: 00000100:00100000:2.0:1788969876.934683:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741449600:0@lo:503: 00000100:00100000:2.0:1788969876.934723:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.934753:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850bb0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788969876.935024:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741449600 00000100:00100000:1.0:1788969876.935029:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741449600 00000100:00100000:1.0:1788969876.935252:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788969876.935261:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741449600:12345-0@lo:503: 00000100:00100000:1.0:1788969876.935408:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741449600:12345-0@lo:503: Request processed in 149us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969876.935423:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788969876.935489:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741449600:0@lo:503: 00000100:00100000:2.0:1788969876.936964:0:8138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8138:1875870741449728:0@lo:502: 00000100:00100000:2.0:1788969876.937026:0:8138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.937315:0:8138:0:(client.c:2716:ptlrpc_set_wait()) set ffff977845502780 going to sleep for 11 seconds 00000100:00100000:3.0:1788969876.937384:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741449728 00000100:00100000:3.0:1788969876.937391:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741449728 00000100:00100000:3.0:1788969876.937423:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788969876.937433:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:8138:x1875870741449728:12345-0@lo:502: 00000100:00100000:3.0:1788969876.937682:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:8138:x1875870741449728:12345-0@lo:502: Request processed in 250us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969876.937695:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788969876.937822:0:8138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8138:1875870741449728:0@lo:502: 00000100:00100000:2.0:1788969876.937872:0:8138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8138:1875870741449856:0@lo:502: 00000100:00100000:2.0:1788969876.937911:0:8138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.937925:0:8138:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850bb0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788969876.937975:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741449856 00000100:00100000:1.0:1788969876.937979:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741449856 00000100:00100000:1.0:1788969876.938000:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788969876.938005:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:8138:x1875870741449856:12345-0@lo:502: 00000100:00100000:2.0:1788969876.939376:0:8138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8138:1875870741449856:0@lo:502: 00000040:00080000:2.0:1788969876.939417:0:8138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:1.0:1788969876.939583:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:8138:x1875870741449856:12345-0@lo:502: Request processed in 1575us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969876.939593:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000020:01000000:1.0:1788969876.939879:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788969876.939904:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788969876.939914:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.939925:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969876.939935:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788969876.939938:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788969876.939940:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788969876.939971:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.939979:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.939987:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969876.940003:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741449984:0@lo:101: 00000100:00100000:1.0:1788969876.940178:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969876.940252:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274780 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.940350:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741449984 00000100:00100000:0.0:1788969876.940356:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741449984 00000100:00100000:2.0:1788969876.940410:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788969876.940419:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741449984:12345-0@lo:101: 00010000:00010000:2.0:1788969876.940431:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969876.940443:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3a2c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.940465:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3a2c expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.940477:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a2c expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.940486:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd200, rc 0) 00000100:00100000:2.0:1788969876.940580:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741449984:12345-0@lo:101: Request processed in 161us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969876.940587:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788969876.940707:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741449984:0@lo:101: 00010000:00010000:1.0:1788969876.940721:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.940729:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969876.940777:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450112:0@lo:501: 00000100:00100000:0.0:1788969876.941032:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.941201:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274780 going to sleep for 11 seconds 00000100:00100000:2.0:1788969876.941228:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741450112 00000100:00100000:2.0:1788969876.941232:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741450112 00000100:00100000:2.0:1788969876.941280:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788969876.941287:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741450112:12345-0@lo:501: 00000100:00100000:2.0:1788969876.941498:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741450112:12345-0@lo:501: Request processed in 211us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969876.941504:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788969876.941571:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450112:0@lo:501: 00000100:00100000:1.0:1788969876.941596:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450240:0@lo:503: 00000100:00100000:1.0:1788969876.941628:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969876.942038:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274780 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.942297:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741450240 00000100:00100000:0.0:1788969876.942303:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741450240 00000100:00100000:0.0:1788969876.942326:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788969876.942332:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741450240:12345-0@lo:503: 00000100:00100000:0.0:1788969876.942514:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741450240:12345-0@lo:503: Request processed in 181us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.942520:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788969876.942754:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450240:0@lo:503: 00000100:00100000:1.0:1788969876.943360:0:8139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8139:1875870741450368:0@lo:502: 00000100:00100000:1.0:1788969876.943394:0:8139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969876.943417:0:8139:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274840 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.943466:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741450368 00000100:00100000:0.0:1788969876.943470:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741450368 00000100:00100000:0.0:1788969876.943496:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788969876.943501:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:8139:x1875870741450368:12345-0@lo:502: 00000100:00100000:0.0:1788969876.943656:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:8139:x1875870741450368:12345-0@lo:502: Request processed in 154us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.943662:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788969876.943726:0:8139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8139:1875870741450368:0@lo:502: 00000020:01000000:1.0:1788969876.943746:0:8139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788969876.943753:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969876.943755:0:8139:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788969876.943760:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788969876.943762:0:8139:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788969876.943774:0:8139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8139:1875870741450496:0@lo:502: 00000100:00100000:1.0:1788969876.943834:0:8139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969876.943848:0:8139:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274840 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.943946:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741450496 00000100:00100000:0.0:1788969876.943950:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741450496 00000100:00100000:0.0:1788969876.943975:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788969876.943980:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:8139:x1875870741450496:12345-0@lo:502: 00000100:00100000:0.0:1788969876.944225:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:8139:x1875870741450496:12345-0@lo:502: Request processed in 244us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.944236:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788969876.944291:0:8139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8139:1875870741450496:0@lo:502: 00000020:01000000:1.0:1788969876.944307:0:8139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788969876.944311:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969876.944313:0:8139:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788969876.944317:0:8139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788969876.944556:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788969876.944574:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788969876.944583:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.944594:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969876.944603:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788969876.944606:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97786f03a800 from 30 10000000:01000000:0.0:1788969876.944608:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788969876.944631:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.944639:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.944648:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969876.944662:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450624:0@lo:101: 00000100:00100000:0.0:1788969876.944687:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.944715:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778503f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788969876.944755:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741450624 00000100:00100000:1.0:1788969876.944759:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741450624 00000100:00100000:1.0:1788969876.944785:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788969876.944813:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741450624:12345-0@lo:101: 00010000:00010000:1.0:1788969876.944822:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969876.944833:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3a3a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.944853:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3a3a expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.944863:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a3a expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.944871:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9200, rc 0) 00000100:00100000:1.0:1788969876.944975:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741450624:12345-0@lo:101: Request processed in 163us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969876.944981:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788969876.945181:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450624:0@lo:101: 00010000:00010000:2.0:1788969876.945195:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.945203:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969876.945247:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450752:0@lo:501: 00000100:00100000:2.0:1788969876.945273:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.945297:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977853619180 going to sleep for 11 seconds 00000100:00100000:1.0:1788969876.945340:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741450752 00000100:00100000:1.0:1788969876.945344:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741450752 00000100:00100000:1.0:1788969876.945361:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788969876.945367:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741450752:12345-0@lo:501: 00000100:00100000:1.0:1788969876.945601:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741450752:12345-0@lo:501: Request processed in 234us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969876.945608:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788969876.945719:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450752:0@lo:501: 00000100:00100000:2.0:1788969876.945746:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450880:0@lo:503: 00000100:00100000:2.0:1788969876.945781:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.945832:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977853619180 going to sleep for 11 seconds 00000100:00100000:1.0:1788969876.945988:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741450880 00000100:00100000:1.0:1788969876.945993:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741450880 00000100:00100000:1.0:1788969876.946058:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788969876.946065:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741450880:12345-0@lo:503: 00000100:00100000:1.0:1788969876.946313:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741450880:12345-0@lo:503: Request processed in 248us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969876.946321:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788969876.946443:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741450880:0@lo:503: 00000100:00100000:2.0:1788969876.947394:0:8140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8140:1875870741451008:0@lo:502: 00000100:00100000:2.0:1788969876.947441:0:8140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.947505:0:8140:0:(client.c:2716:ptlrpc_set_wait()) set ffff977853619180 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.947543:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741451008 00000100:00100000:0.0:1788969876.947558:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741451008 00000100:00100000:0.0:1788969876.947622:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788969876.947632:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:8140:x1875870741451008:12345-0@lo:502: 00000100:00100000:0.0:1788969876.948281:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:8140:x1875870741451008:12345-0@lo:502: Request processed in 649us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.948295:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788969876.948450:0:8140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8140:1875870741451008:0@lo:502: 00000100:00100000:2.0:1788969876.948501:0:8140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8140:1875870741451136:0@lo:502: 00000100:00100000:2.0:1788969876.948534:0:8140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.948658:0:8140:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f936180 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.948692:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741451136 00000100:00100000:0.0:1788969876.948696:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741451136 00000100:00100000:0.0:1788969876.948728:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788969876.948734:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:8140:x1875870741451136:12345-0@lo:502: 00000100:00100000:0.0:1788969876.949243:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:8140:x1875870741451136:12345-0@lo:502: Request processed in 508us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.949250:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788969876.949336:0:8140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8140:1875870741451136:0@lo:502: 00000040:00080000:1.0:1788969876.949360:0:8140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788969876.949506:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788969876.949521:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788969876.949530:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.949542:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969876.949561:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788969876.949564:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97786f03a800 from 5 10000000:01000000:0.0:1788969876.949566:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788969876.949592:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.949599:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.949608:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969876.949621:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451264:0@lo:101: 00000100:00100000:0.0:1788969876.949654:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.949682:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977852a5ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788969876.949726:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741451264 00000100:00100000:1.0:1788969876.949730:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741451264 00000100:00100000:1.0:1788969876.949762:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788969876.949768:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741451264:12345-0@lo:101: 00010000:00010000:1.0:1788969876.949778:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969876.949812:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a9000/0x5d0de860b05b3a4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3a48 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.949833:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9000/0x5d0de860b05b3a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3a48 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.949843:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a9000/0x5d0de860b05b3a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a48 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969876.949852:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9000, rc 0) 00000100:00100000:1.0:1788969876.949882:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741451264:12345-0@lo:101: Request processed in 114us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969876.949904:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788969876.950016:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451264:0@lo:101: 00010000:00010000:0.0:1788969876.950028:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.950036:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969876.950195:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451392:0@lo:256: 00000100:00100000:0.0:1788969876.950222:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.950248:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977852a5ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.950260:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741451392 00000100:00100000:0.0:1788969876.950263:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741451392 00000100:00100000:0.0:1788969876.950281:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788969876.950286:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741451392:12345-0@lo:256: 20000000:01000000:0.0:1788969876.950297:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788969876.950312:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788969876.950315:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788969876.950398:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741451392:12345-0@lo:256: Request processed in 111us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.950404:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788969876.950425:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451392:0@lo:256: 10000000:01000000:0.0:1788969876.950463:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788969876.950469:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.950487:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969876.950494:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788969876.950496:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788969876.950498:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788969876.950513:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.950520:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.950527:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969876.950537:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451520:0@lo:101: 00000100:00100000:0.0:1788969876.950573:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.950582:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977852a5ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.950597:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741451520 00000100:00100000:0.0:1788969876.950600:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741451520 00000100:00100000:0.0:1788969876.950614:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788969876.950619:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741451520:12345-0@lo:101: 00010000:00010000:0.0:1788969876.950625:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969876.950633:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3a56 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.950646:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3a56 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.950666:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a56 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.950674:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4e00, rc 0) 00000100:00100000:0.0:1788969876.950702:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741451520:12345-0@lo:101: Request processed in 83us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.950708:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788969876.950729:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451520:0@lo:101: 00010000:00010000:0.0:1788969876.950738:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.950745:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969876.950781:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451648:0@lo:501: 00000100:00100000:0.0:1788969876.950837:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.950846:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977852a5ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.950861:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741451648 00000100:00100000:0.0:1788969876.950864:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741451648 00000100:00100000:0.0:1788969876.950878:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788969876.950884:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741451648:12345-0@lo:501: 00000100:00100000:0.0:1788969876.951414:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741451648:12345-0@lo:501: Request processed in 528us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.951421:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788969876.951761:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451648:0@lo:501: 00000100:00100000:0.0:1788969876.951972:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451776:0@lo:503: 00000100:00100000:0.0:1788969876.952013:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969876.952142:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741451776 00000100:00100000:1.0:1788969876.952147:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741451776 00000100:00100000:1.0:1788969876.952186:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788969876.952194:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741451776:12345-0@lo:503: 00000100:00100000:1.0:1788969876.952408:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741451776:12345-0@lo:503: Request processed in 214us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969876.952415:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788969876.952578:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977852a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788969876.952593:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741451776:0@lo:503: 00000100:00100000:0.0:1788969876.953391:0:8141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8141:1875870741451904:0@lo:502: 00000100:00100000:0.0:1788969876.953438:0:8141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.953508:0:8141:0:(client.c:2716:ptlrpc_set_wait()) set ffff977852a5e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788969876.953562:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741451904 00000100:00100000:3.0:1788969876.953568:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741451904 00000100:00100000:3.0:1788969876.953640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788969876.953648:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8141:x1875870741451904:12345-0@lo:502: 00000100:00100000:3.0:1788969876.953926:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8141:x1875870741451904:12345-0@lo:502: Request processed in 279us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969876.953933:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788969876.954007:0:8141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8141:1875870741451904:0@lo:502: 00000020:01000000:0.0:1788969876.954030:0:8141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788969876.954037:0:8141:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788969876.954044:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788969876.954046:0:8141:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788969876.954063:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788969876.954067:0:8141:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:0.0:1788969876.954086:0:8141:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788969876.954089:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788969876.954103:0:8141:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff977879218000) 00000020:00000080:0.0:1788969876.954131:0:8141:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788969876.954139:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788969876.954205:0:8141:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788969876.954211:0:8141:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788969876.954230:0:8141:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b3a6b 00010000:00080000:0.0:1788969876.954258:0:8141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97787f94d000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788969876.954471:0:8141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788969876.954774:0:8141:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788969876.954785:0:8141:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788969876.955328:0:8141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788969876.955536:0:8141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788969876.955598:0:8141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788969876.955656:0:8141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788969876.956454:0:8142:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788969876.956458:0:8142:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788969876.957025:0:8141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788969876.957043:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788969876.957245:0:8141:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788969876.957265:0:8141:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b3a72 00000100:00080000:2.0:1788969876.957275:0:8141:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788969876.957285:0:8141:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97787f94d000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788969876.957315:0:8141:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff977878a30000 x1875870741452032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788969876.957341:0:8141:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788969876.957387:0:8141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788969876.957391:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969876.957393:0:8141:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788969876.957395:0:8141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788969876.957399:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969876.957400:0:8141:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788969876.957403:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788969876.957404:0:8141:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788969876.957428:0:8141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a31a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8141:1875870741452160:0@lo:502: 00000100:00100000:2.0:1788969876.957494:0:8141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.957539:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741452032:0@lo:8: 00000100:00100000:0.0:1788969876.957601:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.957720:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741452032 00000100:00100000:0.0:1788969876.957726:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741452032 00000100:00100000:0.0:1788969876.957753:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788969876.957760:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875870741452032:12345-0@lo:8: 00010000:00080000:0.0:1788969876.957780:0:6679:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:0.0:1788969876.957821:0:6679:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b3a79 00002000:00100000:0.0:1788969876.957833:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97787f949800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788969876.957838:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788969876.957841:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788969876.957932:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788969876.958333:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741452544:0@lo:400: 00000100:00100000:2.0:1788969876.958359:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969876.958376:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788969876.958382:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741452416:0@lo:400: 00000100:00100000:2.0:1788969876.958403:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788969876.958454:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788969876.958474:0:6679:0:(import.c:65:import_set_state_nolock()) ffff97787f94b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788969876.958515:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1875870741452032:12345-0@lo:8: Request processed in 753us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.958522:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788969876.958535:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741452544 00000100:00100000:0.0:1788969876.958538:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741452544 00000100:00100000:0.0:1788969876.958571:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788969876.958577:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741452544:12345-0@lo:400: 00000100:00100000:0.0:1788969876.958608:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741452544:12345-0@lo:400: Request processed in 32us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.958614:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788969876.958631:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741452288:0@lo:400: 00000100:00100000:0.0:1788969876.958654:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.958672:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788969876.958677:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741452672:0@lo:400: 00000100:00100000:0.0:1788969876.958706:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788969876.958750:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977855c16580 x1875870741452544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969876.958763:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741452544:0@lo:400: 00000100:00100000:0.0:1788969876.958783:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741452416 00000100:00100000:0.0:1788969876.958786:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741452416 00000100:00100000:0.0:1788969876.958831:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741452288 00000100:00100000:0.0:1788969876.958835:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741452288 00000100:00100000:0.0:1788969876.958847:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741452672 00000100:00100000:0.0:1788969876.958849:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741452672 00000100:00100000:0.0:1788969876.958863:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788969876.958869:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741452416:12345-0@lo:400: 00000100:00100000:0.0:1788969876.958903:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741452416:12345-0@lo:400: Request processed in 34us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.958909:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788969876.958920:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788969876.958926:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741452288:12345-0@lo:400: 00000100:00100000:0.0:1788969876.958953:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741452288:12345-0@lo:400: Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.958959:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788969876.958970:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788969876.958975:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741452672:12345-0@lo:400: 00000100:00100000:0.0:1788969876.958998:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741452672:12345-0@lo:400: Request processed in 24us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.959004:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788969876.959021:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788969876.959036:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977855c14000 x1875870741452416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969876.959066:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741452416:0@lo:400: 00010000:00080000:0.0:1788969876.959094:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977855c15680 x1875870741452672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969876.959102:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741452672:0@lo:400: 00010000:00080000:0.0:1788969876.959119:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977855c14780 x1875870741452288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788969892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969876.959128:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741452288:0@lo:400: 00010000:00080000:0.0:1788969876.959149:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878a30000 x1875870741452032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788969886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969876.959157:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788969876.959163:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788969876.959169:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788969876.959173:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788969876.959175:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787f94d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788969876.959184:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788969876.959188:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741452032:0@lo:8: 00000100:00100000:1.0:1788969876.960197:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741452160 00000100:00100000:1.0:1788969876.960206:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741452160 00000100:00100000:0.0:1788969876.960300:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788969876.960307:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8141:x1875870741452160:12345-0@lo:502: 00000100:00100000:0.0:1788969876.960515:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8141:x1875870741452160:12345-0@lo:502: Request processed in 207us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969876.960521:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:2.0:1788969876.963374:0:8142:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788969876.964217:0:8142:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 188927426393ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788969876.964259:0:8141:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f936180 going to sleep for 11 seconds 00000100:00100000:2.0:1788969876.964295:0:8141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a31a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8141:1875870741452160:0@lo:502: 00000020:01000000:2.0:1788969876.964334:0:8141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788969876.964348:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969876.964350:0:8141:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788969876.964356:0:8141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788969876.964501:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788969876.964520:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788969876.964531:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969876.964541:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969876.964560:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788969876.964563:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9778652a99c0 from 1 10000000:01000000:3.0:1788969876.964565:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788969876.964598:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969876.964606:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969876.964615:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969876.964633:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741452800:0@lo:101: 00000100:00100000:3.0:1788969876.964696:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969876.964732:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70840 going to sleep for 11 seconds 00000100:00100000:2.0:1788969876.964884:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741452800 00000100:00100000:2.0:1788969876.964890:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741452800 00000100:00100000:2.0:1788969876.964933:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788969876.964942:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741452800:12345-0@lo:101: 00010000:00010000:2.0:1788969876.964954:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969876.964966:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3a80 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.964987:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3a80 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.964998:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a80 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969876.965006:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dce00, rc 0) 00000100:00100000:2.0:1788969876.965044:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741452800:12345-0@lo:101: Request processed in 104us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969876.965049:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788969876.965188:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741452800:0@lo:101: 00010000:00010000:0.0:1788969876.965200:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969876.965216:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969876.965256:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741452928:0@lo:501: 00000100:00100000:0.0:1788969876.965276:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969876.965300:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977852a5e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788969876.965343:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741452928 00000100:00100000:3.0:1788969876.965347:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741452928 00000100:00100000:3.0:1788969876.965378:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788969876.965384:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741452928:12345-0@lo:501: 00000100:00100000:3.0:1788969876.965535:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741452928:12345-0@lo:501: Request processed in 151us (257us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788969876.965540:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788969876.965582:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741452928:0@lo:501: 10000000:01000000:3.0:1788969876.965603:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788969876.965609:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969876.965616:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788969877.011064:0:8143:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788969877.011237:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741453056:0@lo:13: 00000100:00100000:0.0:1788969877.011301:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969877.011362:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741453056 00000100:00100000:0.0:1788969877.011369:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741453056 00000100:00100000:0.0:1788969877.011420:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788969877.011428:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741453056:12345-0@lo:13: 00002000:00000024:0.0:1788969877.011459:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788969877.011504:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741453056:12345-0@lo:13: Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969877.011510:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788969877.011530:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788969877.011949:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778615ce1c0 x1875870741453056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969877.011968:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741453056:0@lo:13: 00000100:00100000:1.0:1788969877.014978:0:8143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8143:1875870741453184:0@lo:7: 00000100:00100000:1.0:1788969877.015090:0:8143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969877.015130:0:8143:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788969877.017036:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741453184 00000100:00100000:2.0:1788969877.017051:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741453184 00000100:00100000:2.0:1788969877.017237:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788969877.017673:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8143:x1875870741453184:12345-0@lo:7: 00002000:00080000:2.0:1788969877.026986:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788969877.026994:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788969877.027216:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8143:x1875870741453184:12345-0@lo:7: Request processed in 9417us (11994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969877.027230:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788969877.027576:0:8143:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778615cc000 x1875870741453184/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788969893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969877.027593:0:8143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8143:1875870741453184:0@lo:7: 00000004:00080000:2.0:1788969877.027608:0:8143:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788969877.027647:0:8143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a31a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8143:1875870741453312:0@lo:5: 00000100:00100000:2.0:1788969877.027683:0:8143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969877.027719:0:8143:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1788969877.028308:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741453312 00000100:00100000:0.0:1788969877.028315:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741453312 00000100:00100000:0.0:1788969877.028370:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788969877.028381:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8143:x1875870741453312:12345-0@lo:5: 00002000:00080000:0.0:1788969877.028406:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788969877.028418:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788969877.028842:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8143:x1875870741453312:12345-0@lo:5: Request processed in 463us (1157us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788969877.028850:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788969877.029008:0:8143:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878a31a40 x1875870741453312/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788969893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969877.029022:0:8143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a31a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8143:1875870741453312:0@lo:5: 00000004:00080000:2.0:1788969877.029032:0:8143:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788969877.029062:0:8143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8143:1875870741453440:0@lo:700: 00000100:00100000:2.0:1788969877.029361:0:8143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969877.029383:0:8143:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1788969877.029638:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741453440 00000100:00100000:0.0:1788969877.029644:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741453440 00000100:00100000:0.0:1788969877.029676:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788969877.029685:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8143:x1875870741453440:12345-0@lo:700: 00000100:00100000:0.0:1788969877.029719:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1875870741453568:0@lo:700: 00000100:00100000:0.0:1788969877.029752:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969877.029778:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788969877.029970:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741453568 00000100:00100000:2.0:1788969877.029976:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741453568 00000100:00100000:2.0:1788969877.030006:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788969877.030012:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1875870741453568:12345-0@lo:700: 00000004:00080000:1.0:1788969877.034876:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788969877.062191:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788969877.065761:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1875870741453568:12345-0@lo:700: Request processed in 35742us (36000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969877.065776:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788969877.065854:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778616d52c0 x1875870741453568/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788969893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969877.065869:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1875870741453568:0@lo:700: 40000000:02000000:2.0:1788969877.065888:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1788969877.139184:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788969877.139199:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788969877.139350:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8143:x1875870741453440:12345-0@lo:700: Request processed in 109663us (109986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969877.139365:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788969877.139423:0:8143:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878a312c0 x1875870741453440/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788969893 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969877.139436:0:8143:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788969877.139452:0:8143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8143:1875870741453440:0@lo:700: 00000004:02000040:2.0:1788969877.183333:0:8143:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788969877.188112:0:8143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8143:1875870741453696:0@lo:5: 00000100:00100000:3.0:1788969877.188189:0:8143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969877.188257:0:8143:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788969877.188329:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741453696 00000100:00100000:1.0:1788969877.188336:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741453696 00000100:00100000:1.0:1788969877.188389:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788969877.188397:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8143:x1875870741453696:12345-0@lo:5: 00002000:00080000:0.0:1788969877.197856:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788969877.197875:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788969877.201540:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8143:x1875870741453696:12345-0@lo:5: Request processed in 13135us (13343us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788969877.201562:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788969877.201723:0:8143:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cef840 x1875870741453696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788969893 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969877.201741:0:8143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8143:1875870741453696:0@lo:5: 00000004:00080000:2.0:1788969877.201756:0:8143:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:3.0:1788969877.324694:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788969877.573321:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969878.601412:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969878.714140:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969878.714379:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731993472 00000100:00100000:0.0:1788969878.714388:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731993472 00000100:00100000:0.0:1788969878.714429:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 111 00000100:00100000:0.0:1788969878.714436:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1875870731993472:12345-192.168.202.9@tcp:250: 00010000:00080000:0.0:1788969878.714460:0:5825:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 537f4ae5-7bf7-40b1-8a87-b6178a7df48c@192.168.202.9@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788969878.714485:0:5825:0:(genops.c:1384:class_connect()) connect: client 537f4ae5-7bf7-40b1-8a87-b6178a7df48c, cookie 0x5d0de860b05b3a8e 00000100:00080000:0.0:1788969878.714641:0:5825:0:(import.c:65:import_set_state_nolock()) ffff97787f94f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788969878.714703:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+5:2352:x1875870731993472:12345-192.168.202.9@tcp:250: Request processed in 267us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969878.714709:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 111 00000100:00100000:3.0:1788969878.717343:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969878.717501:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731993344 00000100:00100000:2.0:1788969878.717509:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731993344 00000100:00100000:2.0:1788969878.717572:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 112 00000100:00100000:2.0:1788969878.717582:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+5:5584:x1875870731993344:12345-192.168.202.9@tcp:101: 00010000:00010000:2.0:1788969878.717599:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969878.717614:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e769 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969878.717637:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e769 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969878.717645:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e769 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969878.717663:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dde00, rc 0) 00000100:00100000:2.0:1788969878.717707:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+6:5584:x1875870731993344:12345-192.168.202.9@tcp:101: Request processed in 128us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969878.717712:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 112 00000100:00100000:1.0:1788969878.723292:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969878.723401:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731993600 00000100:00100000:2.0:1788969878.723410:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731993600 00000100:00100000:2.0:1788969878.723460:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:2.0:1788969878.723467:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+6:5584:x1875870731993600:12345-192.168.202.9@tcp:501: 00000100:00100000:2.0:1788969878.723842:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+6:5584:x1875870731993600:12345-192.168.202.9@tcp:501: Request processed in 373us (557us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788969878.723850:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:3.0:1788969878.731504:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969878.731584:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731993728 00000100:00100000:0.0:1788969878.731610:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731993728 00000100:00100000:0.0:1788969878.731750:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:0.0:1788969878.731760:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+6:5584:x1875870731993728:12345-192.168.202.9@tcp:101: 00010000:00010000:0.0:1788969878.731778:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969878.731834:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e770 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969878.731875:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e770 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969878.731885:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e770 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969878.731893:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5400, rc 0) 00000100:00100000:0.0:1788969878.731958:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+7:5584:x1875870731993728:12345-192.168.202.9@tcp:101: Request processed in 199us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969878.731964:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:3.0:1788969878.736593:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969878.736829:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731993856 00000100:00100000:2.0:1788969878.736839:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731993856 00000100:00100000:2.0:1788969878.736909:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:2.0:1788969878.736920:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+7:5584:x1875870731993856:12345-192.168.202.9@tcp:501: 00000100:00100000:2.0:1788969878.737234:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:5584:x1875870731993856:12345-192.168.202.9@tcp:501: Request processed in 315us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969878.737243:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:1.0:1788969878.743664:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969878.743725:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731993984 00000100:00100000:0.0:1788969878.743736:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731993984 00000100:00100000:0.0:1788969878.743822:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:0.0:1788969878.743834:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:5584:x1875870731993984:12345-192.168.202.9@tcp:503: 00000100:00100000:0.0:1788969878.744238:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:5584:x1875870731993984:12345-192.168.202.9@tcp:503: Request processed in 405us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969878.744246:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:3.0:1788969878.750116:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969878.750187:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731994112 00000100:00100000:0.0:1788969878.750198:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731994112 00000100:00100000:0.0:1788969878.750333:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:0.0:1788969878.750344:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:5603:x1875870731994112:12345-192.168.202.9@tcp:502: 00000100:00100000:0.0:1788969878.750719:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:5603:x1875870731994112:12345-192.168.202.9@tcp:502: Request processed in 376us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969878.750727:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:1.0:1788969878.804505:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969878.804674:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731994240 00000100:00100000:2.0:1788969878.804685:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731994240 00000100:00100000:2.0:1788969878.804748:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:2.0:1788969878.804759:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:5603:x1875870731994240:12345-192.168.202.9@tcp:502: 00000100:00100000:2.0:1788969878.805076:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:5603:x1875870731994240:12345-192.168.202.9@tcp:502: Request processed in 317us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969878.805093:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:1.0:1788969878.810836:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969878.811071:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731994368 00000100:00100000:0.0:1788969878.811083:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731994368 00000100:00100000:0.0:1788969878.811154:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:0.0:1788969878.811165:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:5584:x1875870731994368:12345-192.168.202.9@tcp:101: 00010000:00010000:0.0:1788969878.811181:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969878.811201:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e79a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969878.811230:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e79a expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969878.811243:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e79a expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969878.811253:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5000, rc 0) 00000100:00100000:0.0:1788969878.811312:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5584:x1875870731994368:12345-192.168.202.9@tcp:101: Request processed in 149us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969878.811319:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:0.0:1788969878.822044:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969878.824162:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731994496 00000100:00100000:3.0:1788969878.824195:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731994496 00000100:00100000:3.0:1788969878.824321:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:3.0:1788969878.824334:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5584:x1875870731994496:12345-192.168.202.9@tcp:256: 20000000:01000000:3.0:1788969878.824362:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788969878.824381:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788969878.824385:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788969878.824388:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788969878.824390:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788969878.831475:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5584:x1875870731994496:12345-192.168.202.9@tcp:256: Request processed in 7132us (9441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969878.831490:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:1.0:1788969878.835190:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969878.835296:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731994624 00000100:00100000:2.0:1788969878.835306:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731994624 00000100:00100000:2.0:1788969878.835363:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 121 00000100:00100000:2.0:1788969878.835374:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5584:x1875870731994624:12345-192.168.202.9@tcp:101: 00010000:00010000:2.0:1788969878.835391:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969878.835410:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e7a1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969878.835437:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7a1 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969878.835448:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7a1 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969878.835457:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030200, rc 0) 00000100:00100000:2.0:1788969878.835512:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5584:x1875870731994624:12345-192.168.202.9@tcp:101: Request processed in 139us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969878.835518:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 121 00000100:00100000:1.0:1788969878.837260:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969878.837344:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731994752 00000100:00100000:3.0:1788969878.837352:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731994752 00000100:00100000:3.0:1788969878.837402:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:3.0:1788969878.837412:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5584:x1875870731994752:12345-192.168.202.9@tcp:501: 00000100:00100000:3.0:1788969878.837716:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5584:x1875870731994752:12345-192.168.202.9@tcp:501: Request processed in 305us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969878.837721:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:1.0:1788969878.840506:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969878.840578:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731994880 00000100:00100000:0.0:1788969878.840588:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731994880 00000100:00100000:0.0:1788969878.840647:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00100000:0.0:1788969878.840657:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5584:x1875870731994880:12345-192.168.202.9@tcp:503: 00000100:00100000:0.0:1788969878.841067:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5584:x1875870731994880:12345-192.168.202.9@tcp:503: Request processed in 410us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969878.841085:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00100000:1.0:1788969878.843400:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969878.843516:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731995008 00000100:00100000:3.0:1788969878.843525:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731995008 00000100:00100000:3.0:1788969878.843640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:3.0:1788969878.843650:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5608:x1875870731995008:12345-192.168.202.9@tcp:502: 00000100:00100000:3.0:1788969878.843930:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5608:x1875870731995008:12345-192.168.202.9@tcp:502: Request processed in 280us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969878.843937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:1.0:1788969878.845894:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969878.845975:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731995136 00000100:00100000:2.0:1788969878.845984:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731995136 00000100:00100000:2.0:1788969878.846040:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 125 00000100:00100000:2.0:1788969878.846051:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5608:x1875870731995136:12345-192.168.202.9@tcp:502: 00000100:00100000:2.0:1788969878.846295:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5608:x1875870731995136:12345-192.168.202.9@tcp:502: Request processed in 246us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969878.846303:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 125 00000100:00100000:1.0:1788969878.848365:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969878.848520:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731995264 00000100:00100000:0.0:1788969878.848588:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731995264 00000100:00100000:0.0:1788969878.848699:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1788969878.848706:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1875870731995264:12345-192.168.202.9@tcp:38: 00010000:00080000:0.0:1788969878.848731:0:7061:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788969878.848828:0:7061:0:(genops.c:1384:class_connect()) connect: client c7778032-abf5-4f7d-b43e-a87bfd7b090c, cookie 0x5d0de860b05b3ab1 00000004:00100000:0.0:1788969878.848856:0:7061:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:0.0:1788969878.848862:0:7061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788969878.872174:0:7061:0:(import.c:65:import_set_state_nolock()) ffff97784eb71000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788969878.872314:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2352:x1875870731995264:12345-192.168.202.9@tcp:38: Request processed in 23605us (23952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969878.872327:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:1.0:1788969879.380515:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969879.380589:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969879.380754:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731995392 00000100:00100000:2.0:1788969879.380781:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731995392 00000100:00100000:0.0:1788969879.380826:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731995520 00000100:00100000:0.0:1788969879.380831:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731995520 00000100:00100000:2.0:1788969879.380879:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00080000:1.0:1788969879.380881:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969879.380889:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:0:x1875870731995392:12345-192.168.202.9@tcp:41: 00000004:00000024:2.0:1788969879.380934:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788969879.381074:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:0:x1875870731995392:12345-192.168.202.9@tcp:41: Request processed in 186us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969879.381081:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1788969879.383477:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788969879.383498:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:5584:x1875870731995520:12345-192.168.202.9@tcp:41: 00000004:00000024:0.0:1788969879.383542:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788969879.383603:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:5584:x1875870731995520:12345-192.168.202.9@tcp:41: Request processed in 114us (3013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969879.383610:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788969879.388499:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969879.388575:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731995648 00000100:00100000:3.0:1788969879.388585:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731995648 00000100:00100000:3.0:1788969879.388661:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:3.0:1788969879.388672:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:5584:x1875870731995648:12345-192.168.202.9@tcp:40: 00000100:00100000:3.0:1788969879.388760:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:5584:x1875870731995648:12345-192.168.202.9@tcp:40: Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969879.388766:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:1.0:1788969879.393770:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969879.393844:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969879.393889:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969879.393935:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969879.393956:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731996032 00000100:00100000:3.0:1788969879.393966:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731996032 00000100:00100000:1.0:1788969879.393984:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731996160 00000100:00100000:1.0:1788969879.393990:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731996160 00000100:00100000:3.0:1788969879.394011:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:1.0:1788969879.394025:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:3.0:1788969879.394033:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:5584:x1875870731996032:12345-192.168.202.9@tcp:33: 00000100:00100000:1.0:1788969879.394035:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870731996160:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1788969879.394096:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870731996160:12345-192.168.202.9@tcp:400: Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969879.394103:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:2.0:1788969879.394489:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731995776 00000100:00100000:2.0:1788969879.394495:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731995776 00000100:00100000:2.0:1788969879.394533:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731995904 00000100:00100000:2.0:1788969879.394536:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731995904 00000100:00100000:2.0:1788969879.394549:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788969879.394554:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875870731995776:12345-192.168.202.9@tcp:8: 00010000:00080000:2.0:1788969879.394576:0:6679:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1788969879.394603:0:6679:0:(genops.c:1384:class_connect()) connect: client c7778032-abf5-4f7d-b43e-a87bfd7b090c, cookie 0x5d0de860b05b3ab8 00002000:00100000:2.0:1788969879.394614:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c7778032-abf5-4f7d-b43e-a87bfd7b090c/ffff97787f49c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788969879.394637:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788969879.394973:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788969879.395000:0:6679:0:(import.c:65:import_set_state_nolock()) ffff97787f49a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788969879.395034:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2352:x1875870731995776:12345-192.168.202.9@tcp:8: Request processed in 478us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969879.395041:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788969879.395059:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1788969879.395063:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875870731995904:12345-192.168.202.9@tcp:8: 00010000:00080000:2.0:1788969879.395078:0:6679:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1788969879.395095:0:6679:0:(genops.c:1384:class_connect()) connect: client c7778032-abf5-4f7d-b43e-a87bfd7b090c, cookie 0x5d0de860b05b3abf 00002000:00100000:2.0:1788969879.395110:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c7778032-abf5-4f7d-b43e-a87bfd7b090c/ffff97787f49b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788969879.395125:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788969879.396497:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788969879.396542:0:6679:0:(import.c:65:import_set_state_nolock()) ffff97787f49e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788969879.396604:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2352:x1875870731995904:12345-192.168.202.9@tcp:8: Request processed in 1538us (2759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969879.396613:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000004:00080000:3.0:1788969879.421661:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27551us 00000004:00200000:3.0:1788969879.442606:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788969879.442733:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:5584:x1875870731996032:12345-192.168.202.9@tcp:33: Request processed in 48707us (48837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969879.442743:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1788969879.609067:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969879.609182:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731996288 00000100:00100000:3.0:1788969879.609192:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731996288 00000100:00100000:3.0:1788969879.609259:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:3.0:1788969879.609272:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:5625:x1875870731996288:12345-192.168.202.9@tcp:101: 00010000:00010000:3.0:1788969879.609363:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969879.609390:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841544e00/0x5d0de860b05b3ac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e7cb expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969879.609537:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3acd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969879.609551:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3acd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969879.609584:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3acd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969879.609619:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788969879.609623:0:7061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788969879.609637:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3acd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969879.609661:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841544e00/0x5d0de860b05b3ac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7cb expref: 8 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969879.609681:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3acd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7cb expref: 7 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969879.609688:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:3.0:1788969879.609690:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788969879.609694:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841544200, rc 0) 00000100:00100000:3.0:1788969879.609751:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:5625:x1875870731996288:12345-192.168.202.9@tcp:101: Request processed in 482us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969879.609758:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00010000:00010000:0.0:1788969879.622738:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969880.646723:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969881.032687:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741453824:0@lo:13: 00000100:00100000:0.0:1788969881.032770:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969881.032944:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741453824 00000100:00100000:3.0:1788969881.032954:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741453824 00000100:00100000:3.0:1788969881.033038:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788969881.033049:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741453824:12345-0@lo:13: 00002000:00000024:3.0:1788969881.033071:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969881.033119:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741453824:12345-0@lo:13: Request processed in 72us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969881.033126:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788969881.033260:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788969881.033300:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cec000 x1875870741453824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969881.033332:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741453824:0@lo:13: 00000001:00100000:1.0:1788969881.578917:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00010000:00010000:0.0:1788969881.670312:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969881.715130:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969881.715284:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731996416 00000100:00100000:3.0:1788969881.715295:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731996416 00000100:00100000:3.0:1788969881.715373:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:3.0:1788969881.715384:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:5678:x1875870731996416:12345-192.168.202.9@tcp:41: 00000004:00000024:3.0:1788969881.715424:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788969881.715514:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:5678:x1875870731996416:12345-192.168.202.9@tcp:41: Request processed in 118us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969881.715522:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00080000:0.0:1788969881.715588:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969881.722072:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969881.725597:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731996544 00000100:00100000:3.0:1788969881.725618:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731996544 00000100:00100000:3.0:1788969881.725915:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:3.0:1788969881.725926:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:5678:x1875870731996544:12345-192.168.202.9@tcp:13: 00002000:00000024:3.0:1788969881.725965:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969881.726048:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:5678:x1875870731996544:12345-192.168.202.9@tcp:13: Request processed in 123us (3987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969881.726056:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00080000:0.0:1788969881.730864:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788969881.734124:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969881.734379:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731996672 00000100:00100000:2.0:1788969881.734390:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731996672 00000100:00080000:0.0:1788969881.734467:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788969881.734472:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788969881.734484:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:5678:x1875870731996672:12345-192.168.202.9@tcp:13: 00002000:00000024:2.0:1788969881.734531:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788969881.734610:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:5678:x1875870731996672:12345-192.168.202.9@tcp:13: Request processed in 128us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969881.734617:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788969882.053460:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788969882.053486:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741453952:0@lo:13: 00000100:00100000:2.0:1788969882.053565:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969882.053687:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741453952 00000100:00100000:3.0:1788969882.053696:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741453952 00000100:00100000:3.0:1788969882.053750:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788969882.053760:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741453952:12345-0@lo:13: 00002000:00000024:3.0:1788969882.053783:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969882.053846:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741453952:12345-0@lo:13: Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969882.053852:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788969882.053872:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788969882.053999:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878a31a40 x1875870741453952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969882.054149:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788969882.054172:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741453952:0@lo:13: 00000100:00100000:3.0:1788969882.054755:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741454208:0@lo:400: 00000100:00100000:2.0:1788969882.054755:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741454080:0@lo:400: 00000100:00100000:1.0:1788969882.054786:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741454464:0@lo:400: 00000100:00100000:3.0:1788969882.054821:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969882.054822:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969882.054869:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969882.054872:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741454592:0@lo:400: 00000100:00100000:3.0:1788969882.054883:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741454208 00000100:00100000:3.0:1788969882.054888:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741454208 00000100:00100000:1.0:1788969882.054904:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788969882.054915:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741454336:0@lo:400: 00000100:00100000:2.0:1788969882.054919:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969882.054957:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741454464 00000100:00100000:1.0:1788969882.054962:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741454464 00000100:00100000:1.0:1788969882.055440:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788969882.055449:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741454464:12345-0@lo:400: 00000100:00100000:1.0:1788969882.055511:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741454464:12345-0@lo:400: Request processed in 50us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969882.055518:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788969882.055569:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741454080 00000100:00100000:1.0:1788969882.055573:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741454080 00000100:00100000:1.0:1788969882.055595:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788969882.055601:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741454080:12345-0@lo:400: 00000100:00100000:1.0:1788969882.055629:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741454080:12345-0@lo:400: Request processed in 29us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969882.055635:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788969882.058698:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741454080:0@lo:400: 00000100:00100000:0.0:1788969882.059653:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788969882.061175:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d43c00 x1875870741454464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969882.061192:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741454464:0@lo:400: 00000100:00100000:3.0:1788969882.061475:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741454592 00000100:00100000:3.0:1788969882.061484:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741454592 00000100:00100000:0.0:1788969882.068193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788969882.068213:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741454208:12345-0@lo:400: 00000100:00100000:0.0:1788969882.068303:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741454208:12345-0@lo:400: Request processed in 101us (13484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969882.068308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788969882.068325:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788969882.068331:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741454592:12345-0@lo:400: 00000100:00100000:0.0:1788969882.068353:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741454592:12345-0@lo:400: Request processed in 24us (13441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969882.068357:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788969882.069810:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741454208:0@lo:400: 00000100:00080000:3.0:1788969882.069847:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969882.069933:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741454592:0@lo:400: 00000100:00100000:2.0:1788969882.072133:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741454336 00000100:00100000:2.0:1788969882.072146:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741454336 00000100:00100000:2.0:1788969882.072220:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788969882.072223:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969882.072232:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741454336:12345-0@lo:400: 00000100:00100000:2.0:1788969882.072337:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741454336:12345-0@lo:400: Request processed in 108us (12686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969882.072345:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788969882.072373:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741454336:0@lo:400: 00010000:00010000:1.0:1788969882.694006:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788969883.664501:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00010000:00010000:1.0:1788969883.717762:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788969883.928264:0:8265:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788969884.143020:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00010000:00010000:1.0:1788969884.741050:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969884.743552:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969884.743588:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969884.743621:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969884.743648:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969884.743682:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731997056 00000100:00100000:1.0:1788969884.743704:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731997056 00000100:00100000:3.0:1788969884.743710:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731996800 00000100:00100000:3.0:1788969884.743725:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731996800 00000100:00100000:1.0:1788969884.743779:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731997184 00000100:00100000:1.0:1788969884.743785:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731997184 00000100:00100000:3.0:1788969884.743834:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 128 00000100:00100000:3.0:1788969884.743850:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2353:x1875870731996800:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1788969884.743866:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1788969884.743877:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870731997056:12345-192.168.202.9@tcp:400: 00000100:00100000:3.0:1788969884.743959:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2353:x1875870731996800:12345-192.168.202.9@tcp:400: Request processed in 112us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969884.743968:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 128 00000100:00100000:1.0:1788969884.744038:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870731997056:12345-192.168.202.9@tcp:400: Request processed in 160us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969884.744046:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1788969884.744073:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1788969884.744081:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870731997184:12345-192.168.202.9@tcp:400: 00000100:00100000:3.0:1788969884.744107:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731996928 00000100:00100000:1.0:1788969884.744116:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870731997184:12345-192.168.202.9@tcp:400: Request processed in 32us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969884.744118:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731996928 00000100:00100000:1.0:1788969884.744128:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00080000:1.0:1788969884.744169:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969884.744175:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00080000:1.0:1788969884.744175:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788969884.744180:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788969884.744191:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870731996928:12345-192.168.202.9@tcp:400: 00000100:00100000:3.0:1788969884.744237:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870731996928:12345-192.168.202.9@tcp:400: Request processed in 50us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969884.744247:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00010000:00010000:1.0:1788969885.768361:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969886.149059:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741454720:0@lo:13: 00000100:00100000:1.0:1788969886.149207:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969886.149540:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741454720 00000100:00100000:0.0:1788969886.149549:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741454720 00000100:00100000:0.0:1788969886.149617:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788969886.149639:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741454720:12345-0@lo:13: 00002000:00000024:0.0:1788969886.149694:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788969886.149741:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741454720:12345-0@lo:13: Request processed in 104us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969886.149748:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788969886.150247:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788969886.150282:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778539b8000 x1875870741454720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969886.150303:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741454720:0@lo:13: 00010000:00010000:0.0:1788969886.790198:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788969887.078511:0:8415:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedf319eb0 20000000:00000080:2.0:1788969887.078529:0:8415:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff977878f71400 uarg=0000000000000000 20000000:01000000:2.0:1788969887.078565:0:8415:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788969887.078568:0:8415:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788969887.078570:0:8415:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788969887.078575:0:8415:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788969887.078579:0:8415:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788969887.078593:0:8415:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788969887.078595:0:8415:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788969887.078756:0:8415:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788969887.078759:0:8415:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788969887.080316:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788969887.080763:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788969887.081751:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788969887.082123:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788969887.082217:0:8415:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788969887.082220:0:8415:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788969887.083358:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788969887.083762:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788969887.084236:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788969887.084279:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788969887.084295:0:8415:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788969887.084297:0:8415:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788969887.085126:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788969887.085641:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788969887.085692:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788969887.085731:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788969887.085745:0:8415:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788969887.085747:0:8415:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788969887.087312:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788969887.087731:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788969887.088126:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788969887.088251:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1788969887.088271:0:8415:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788969887.088291:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088307:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b39ca expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088314:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b39f4 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088320:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a1e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088326:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a2c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088332:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a3a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088338:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a56 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088354:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3a80 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088364:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e769 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088371:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e770 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088379:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088418:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e770 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088434:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e770 expref: 9 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.088448:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741454848:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788969887.088561:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e769 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088570:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e769 expref: 9 pid: 5827 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.088578:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741454976:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788969887.088607:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3a80 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088626:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3a80 expref: 18 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.088636:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455104:0@lo:104: 00000100:00100000:3.0:1788969887.088674:0:8415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788969887.088722:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3a56 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088730:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3a56 expref: 18 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.088738:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ceed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455232:0@lo:104: 00000100:00100000:3.0:1788969887.088757:0:8415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788969887.088773:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3a3a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088780:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3a3a expref: 18 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.088814:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455360:0@lo:104: 00010000:00010000:3.0:1788969887.088838:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3a2c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088846:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3a2c expref: 18 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.088853:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cefc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455488:0@lo:104: 00010000:00010000:3.0:1788969887.088874:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3a1e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088888:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3a1e expref: 18 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.088897:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ced2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455616:0@lo:104: 00010000:00010000:3.0:1788969887.088923:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b39f4 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.088931:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b39f4 expref: 18 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.088938:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455744:0@lo:104: 00000100:00100000:0.0:1788969887.089123:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788969887.089154:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.089184:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.089192:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.089197:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741455104 00000100:00100000:0.0:1788969887.089203:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741455104 00000100:00100000:0.0:1788969887.089237:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741455232 00000100:00100000:0.0:1788969887.089240:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741455232 00000100:00100000:0.0:1788969887.089250:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741455360 00000100:00100000:0.0:1788969887.089252:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741455360 00000100:00100000:0.0:1788969887.089261:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741455488 00000100:00100000:0.0:1788969887.089263:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741455488 00000100:00100000:0.0:1788969887.089271:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741455616 00000100:00100000:0.0:1788969887.089272:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741455616 00000100:00100000:0.0:1788969887.089280:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788969887.089285:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+7:8415:x1875870741455104:12345-0@lo:104: 00010000:00010000:0.0:1788969887.089294:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.089330:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788969887.089335:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+7:8415:x1875870741455104:12345-0@lo:104: Request processed in 50us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.089341:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788969887.089368:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788969887.089374:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+6:8415:x1875870741455232:12345-0@lo:104: 00010000:00010000:0.0:1788969887.089382:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.089412:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788969887.089416:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+6:8415:x1875870741455232:12345-0@lo:104: Request processed in 42us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.089420:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788969887.089443:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788969887.089446:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:8415:x1875870741455360:12345-0@lo:104: 00010000:00010000:0.0:1788969887.089463:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.089493:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788969887.089498:0:8415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.089498:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:8415:x1875870741455360:12345-0@lo:104: Request processed in 51us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.089504:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788969887.089513:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741455744 00000100:00100000:0.0:1788969887.089516:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741455744 00010000:00010000:3.0:1788969887.089518:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b39ca expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.089527:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b39ca expref: 18 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969887.089528:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788969887.089533:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:8415:x1875870741455488:12345-0@lo:104: 00000100:00100000:3.0:1788969887.089536:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455872:0@lo:104: 00010000:00010000:0.0:1788969887.089539:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.089556:0:8415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788969887.089559:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788969887.089563:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:8415:x1875870741455488:12345-0@lo:104: Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969887.089564:0:8415:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83000 going to sleep for 11 seconds 00000100:00100000:0.0:1788969887.089576:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788969887.089581:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455104:0@lo:104: 00000100:00100000:0.0:1788969887.089586:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741455872 00000100:00100000:3.0:1788969887.089588:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ceed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455232:0@lo:104: 00000100:00100000:0.0:1788969887.089589:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741455872 00000100:00100000:3.0:1788969887.089594:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455360:0@lo:104: 00000100:00100000:0.0:1788969887.089600:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788969887.089601:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cefc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455488:0@lo:104: 00000100:00100000:0.0:1788969887.089605:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:8415:x1875870741455616:12345-0@lo:104: 00010000:00010000:0.0:1788969887.089611:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.089638:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788969887.089643:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:8415:x1875870741455616:12345-0@lo:104: Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.089648:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788969887.089659:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788969887.089663:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ced2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455616:0@lo:104: 00000100:00100000:0.0:1788969887.089664:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:8415:x1875870741455744:12345-0@lo:104: 00010000:00010000:0.0:1788969887.089671:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969887.090029:0:7605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788969887.090040:0:7605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:8415:x1875870741455872:12345-0@lo:104: 00010000:00010000:1.0:1788969887.090046:0:7605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090099:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788969887.090104:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:8415:x1875870741455744:12345-0@lo:104: Request processed in 441us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.090109:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788969887.090124:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788969887.090128:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090141:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788969887.090144:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090155:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788969887.090160:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969887.090164:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788969887.090191:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090197:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788969887.090214:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090221:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545e00/0x5d0de860b05b3a80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090232:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788969887.090235:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090240:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4a00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788969887.090243:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090249:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788969887.090254:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969887.090266:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788969887.090288:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090294:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788969887.090299:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090305:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090316:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788969887.090319:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090324:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4c00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788969887.090327:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090333:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788969887.090339:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969887.090344:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788969887.090355:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090361:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788969887.090384:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090391:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff4c00/0x5d0de860b05b3a3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a41 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090400:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788969887.090403:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090409:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8200 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788969887.090411:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090418:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788969887.090423:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969887.090428:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788969887.090439:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090444:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788969887.090449:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090464:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3a2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a33 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090474:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788969887.090482:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090488:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788969887.090491:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090497:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788969887.090504:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969887.090508:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788969887.090530:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090535:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788969887.090539:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090545:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b3a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3a25 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090554:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788969887.090557:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090562:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788969887.090565:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090582:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788969887.090588:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969887.090593:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788969887.090606:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090611:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788969887.090615:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090620:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778821dc000/0x5d0de860b05b39f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39fb expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.090629:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969887.090631:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969887.090633:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969887.090639:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969887.090650:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741456000:0@lo:103: 00000100:00100000:0.0:1788969887.090679:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.090707:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741456512:0@lo:103: 00000100:00100000:0.0:1788969887.090724:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.090741:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788969887.090746:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741456128:0@lo:103: 00000100:00100000:0.0:1788969887.090762:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.090784:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741456640:0@lo:103: 00000100:00100000:0.0:1788969887.090823:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.090843:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741456256:0@lo:103: 00000100:00100000:0.0:1788969887.090862:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.090872:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788969887.090877:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741456384:0@lo:103: 00000100:00100000:0.0:1788969887.090893:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.090914:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741456000 00000100:00100000:0.0:1788969887.090919:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741456000 00010000:00010000:0.0:1788969887.090937:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a80 expref: 19 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969887.090952:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741456512 00000100:00100000:0.0:1788969887.090955:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741456512 00010000:00010000:0.0:1788969887.090964:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a1e expref: 20 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969887.090973:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741456128 00000100:00100000:0.0:1788969887.090975:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741456128 00010000:00010000:0.0:1788969887.090984:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a56 expref: 21 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969887.090993:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741456640 00000100:00100000:0.0:1788969887.090995:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741456640 00010000:00010000:0.0:1788969887.091004:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b39f4 expref: 22 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969887.091013:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741456256 00000100:00100000:0.0:1788969887.091016:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741456256 00010000:00010000:0.0:1788969887.091025:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a3a expref: 23 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969887.091048:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741456384 00000100:00100000:0.0:1788969887.091051:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741456384 00010000:00010000:0.0:1788969887.091063:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a2c expref: 24 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969887.091075:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788969887.091081:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+24:3285:x1875870741456000:12345-0@lo:103: 00010000:00010000:0.0:1788969887.091091:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969887.091096:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a80 expref: 24 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091105:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3a80 expref: 24 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091118:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dce00/0x5d0de860b05b3a87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3a80 expref: 24 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091129:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969887.091159:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+23:3285:x1875870741456000:12345-0@lo:103: Request processed in 78us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.091165:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788969887.091178:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788969887.091184:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+22:3285:x1875870741456512:12345-0@lo:103: 00010000:00010000:0.0:1788969887.091191:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969887.091195:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a1e expref: 22 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091203:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3a1e expref: 22 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091222:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841545000/0x5d0de860b05b3a25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3a1e expref: 22 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091231:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969887.091253:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+21:3285:x1875870741456512:12345-0@lo:103: Request processed in 70us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.091260:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788969887.091272:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788969887.091278:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+20:3285:x1875870741456128:12345-0@lo:103: 00010000:00010000:0.0:1788969887.091285:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969887.091290:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a56 expref: 20 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091298:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3a56 expref: 20 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091308:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3a5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3a56 expref: 20 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091317:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969887.091337:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741456128:12345-0@lo:103: Request processed in 59us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.091343:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788969887.091353:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788969887.091359:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3285:x1875870741456640:12345-0@lo:103: 00010000:00010000:0.0:1788969887.091366:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969887.091369:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b39f4 expref: 18 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091382:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b39f4 expref: 18 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091392:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969887.091413:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3285:x1875870741456640:12345-0@lo:103: Request processed in 54us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.091418:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788969887.091431:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788969887.091436:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:3283:x1875870741456256:12345-0@lo:103: 00010000:00010000:0.0:1788969887.091444:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969887.091448:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a3a expref: 17 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091467:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3a3a expref: 17 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091476:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9200/0x5d0de860b05b3a41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3a3a expref: 17 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091485:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969887.091523:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:3283:x1875870741456256:12345-0@lo:103: Request processed in 87us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.091529:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788969887.091541:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788969887.091546:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:3283:x1875870741456384:12345-0@lo:103: 00010000:00010000:0.0:1788969887.091553:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969887.091557:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3a2c expref: 15 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091570:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3a2c expref: 15 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091580:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dd200/0x5d0de860b05b3a33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3a2c expref: 15 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.091589:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969887.091610:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3283:x1875870741456384:12345-0@lo:103: Request processed in 65us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.091616:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788969887.091652:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741456384:0@lo:103: 00000100:00100000:0.0:1788969887.091652:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741456128:0@lo:103: 00000100:00100000:0.0:1788969887.091660:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741456640:0@lo:103: 00000100:00100000:2.0:1788969887.091663:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741456256:0@lo:103: 00000100:00100000:0.0:1788969887.091666:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741456000:0@lo:103: 00000100:00100000:0.0:1788969887.091672:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741456512:0@lo:103: 00010000:00010000:1.0:1788969887.094928:0:7605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788969887.094944:0:7605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:8415:x1875870741455872:12345-0@lo:104: Request processed in 4901us (5383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969887.094965:0:7605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788969887.095072:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788969887.095080:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.095088:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd600 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788969887.095110:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.095119:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788969887.095127:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788969887.095132:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788969887.095184:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.095191:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788969887.095208:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.095214:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b39ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39d1 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.095234:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969887.095236:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969887.095238:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969887.095260:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741456768:0@lo:103: 00000100:00100000:2.0:1788969887.095306:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788969887.095630:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841545600/0x5d0de860b05b39fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b39f4 expref: 13 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.095644:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455744:0@lo:104: 00000100:00100000:3.0:1788969887.095659:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741455872:0@lo:104: 00000100:00100000:0.0:1788969887.095728:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969887.096337:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741456768 00000100:00100000:2.0:1788969887.096345:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741456768 00010000:00010000:2.0:1788969887.096375:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b39ca expref: 13 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969887.096400:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731997312 00000100:00100000:2.0:1788969887.096412:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731997312 00010000:00010000:2.0:1788969887.096427:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e770 expref: 10 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969887.096442:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788969887.096461:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778600e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:3283:x1875870741456768:12345-0@lo:103: 00010000:00010000:2.0:1788969887.096474:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788969887.096480:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b39ca expref: 13 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.096489:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b39ca expref: 13 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.096503:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841544600/0x5d0de860b05b39d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b39ca expref: 13 pid: 5827 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.096516:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969887.096560:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778600e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:3283:x1875870741456768:12345-0@lo:103: Request processed in 111us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969887.096566:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788969887.096608:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1788969887.096615:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2353:x1875870731997312:12345-192.168.202.9@tcp:103: 00010000:00010000:2.0:1788969887.096623:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788969887.096628:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e770 expref: 10 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.096637:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e770 expref: 10 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.096647:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969887.096689:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2353:x1875870731997312:12345-192.168.202.9@tcp:103: Request processed in 74us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969887.096696:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1788969887.096739:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741456768:0@lo:103: 00000100:00100000:0.0:1788969887.096834:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969887.096859:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731997440 00000100:00100000:0.0:1788969887.096863:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731997440 00010000:00010000:0.0:1788969887.096879:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e769 expref: 10 pid: 5827 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969887.096894:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:0.0:1788969887.096900:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2353:x1875870731997440:12345-192.168.202.9@tcp:103: 00010000:00010000:0.0:1788969887.096908:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969887.096912:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e769 expref: 10 pid: 5827 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.096929:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e769 expref: 10 pid: 5827 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.096942:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.097082:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.097100:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.097107:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.097114:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.097121:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.097127:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841544400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788969887.097130:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.097220:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.097231:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969887.097252:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969887.097277:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2353:x1875870731997440:12345-192.168.202.9@tcp:103: Request processed in 376us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.097284:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00010000:00010000:3.0:1788969887.097445:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3a9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e770 expref: 9 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.097469:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741454848:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788969887.097481:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dde00/0x5d0de860b05b3a95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e769 expref: 8 pid: 5827 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969887.097489:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8415:1875870741454976:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788969887.097526:0:8415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.097534:0:8415:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.097540:0:8415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.097545:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841544400/0x5d0de860b05b3ad4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969887.175194:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741456896:0@lo:400: 00000100:00100000:2.0:1788969887.175270:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969887.175322:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741457408:0@lo:400: 00000100:00100000:2.0:1788969887.175348:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969887.175379:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788969887.175386:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741457280:0@lo:400: 00000100:00100000:2.0:1788969887.175408:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969887.175443:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741456896 00000100:00100000:2.0:1788969887.175462:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741456896 00000100:00100000:2.0:1788969887.175508:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741457280 00000100:00100000:2.0:1788969887.175512:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741457280 00000100:00100000:2.0:1788969887.175544:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788969887.175553:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741456896:12345-0@lo:400: 00000100:00100000:2.0:1788969887.175609:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741456896:12345-0@lo:400: Request processed in 57us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969887.175616:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788969887.175632:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788969887.175638:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741457280:12345-0@lo:400: 00000100:00100000:2.0:1788969887.175664:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741457280:12345-0@lo:400: Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969887.175669:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788969887.175689:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741457408 00000100:00100000:2.0:1788969887.175693:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741457408 00000100:00100000:2.0:1788969887.175737:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788969887.175744:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741457408:12345-0@lo:400: 00000100:00100000:2.0:1788969887.175774:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741457408:12345-0@lo:400: Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969887.175779:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788969887.175821:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788969887.175825:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969887.175857:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741457280:0@lo:400: 00000100:00100000:2.0:1788969887.175875:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741456896:0@lo:400: 00010000:00080000:2.0:1788969887.175887:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d40780 x1875870741457408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969887.175896:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741457408:0@lo:400: 00000100:00100000:0.0:1788969887.176500:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741457024:0@lo:400: 00000100:00100000:0.0:1788969887.176536:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.176558:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741457536:0@lo:13: 00000100:00100000:0.0:1788969887.176580:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.176602:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969887.176608:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741457152:0@lo:400: 00000100:00100000:0.0:1788969887.176630:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969887.176667:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741457536 00000100:00100000:0.0:1788969887.176671:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741457536 00000100:00100000:0.0:1788969887.176701:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788969887.176708:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741457536:12345-0@lo:13: 00002000:00000024:0.0:1788969887.176735:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788969887.176770:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741457536:12345-0@lo:13: Request processed in 62us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.176775:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788969887.176812:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741457152 00000100:00100000:0.0:1788969887.176816:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741457152 00000100:00100000:0.0:1788969887.176836:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788969887.176842:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741457152:12345-0@lo:400: 00000100:00100000:0.0:1788969887.176868:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741457152:12345-0@lo:400: Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969887.176873:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788969887.176909:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d41a40 x1875870741457152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969887.176920:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741457152:0@lo:400: 00010000:00080000:0.0:1788969887.176931:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d40000 x1875870741457536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969887.176942:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741457536:0@lo:13: 00000100:00100000:1.0:1788969887.177062:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741457024 00000100:00100000:1.0:1788969887.177067:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741457024 00000100:00100000:1.0:1788969887.177099:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788969887.177105:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741457024:12345-0@lo:400: 00000100:00100000:1.0:1788969887.177138:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741457024:12345-0@lo:400: Request processed in 34us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969887.177143:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788969887.177221:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969887.177331:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741457024:0@lo:400: 00000100:00100000:1.0:1788969887.473368:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969887.473509:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731997568 00000100:00100000:2.0:1788969887.473520:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731997568 00000100:00100000:2.0:1788969887.475440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 129 00000100:00100000:2.0:1788969887.475491:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:5598:x1875870731997568:12345-192.168.202.9@tcp:101: 00010000:00010000:2.0:1788969887.475509:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969887.475530:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840031400/0x5d0de860b05b3adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e7d2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.475559:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840031400/0x5d0de860b05b3adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7d2 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.475571:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840031400/0x5d0de860b05b3adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7d2 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969887.475594:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031400, rc 0) 00000100:00100000:2.0:1788969887.475648:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5598:x1875870731997568:12345-192.168.202.9@tcp:101: Request processed in 168us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969887.475655:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 129 00000100:00100000:2.0:1788969887.478031:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969887.478112:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731997696 00000100:00100000:1.0:1788969887.478121:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731997696 00000100:00100000:1.0:1788969887.478175:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00100000:1.0:1788969887.478185:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5598:x1875870731997696:12345-192.168.202.9@tcp:501: 00000100:00100000:1.0:1788969887.478454:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5598:x1875870731997696:12345-192.168.202.9@tcp:501: Request processed in 262us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969887.478462:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00100000:0.0:1788969887.481316:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969887.481431:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731997824 00000100:00100000:2.0:1788969887.481440:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731997824 00000100:00100000:2.0:1788969887.481504:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 131 00000100:00100000:2.0:1788969887.481514:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5598:x1875870731997824:12345-192.168.202.9@tcp:503: 00000100:00100000:2.0:1788969887.481740:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5598:x1875870731997824:12345-192.168.202.9@tcp:503: Request processed in 227us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969887.481748:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 131 00000100:00100000:2.0:1788969887.497468:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969887.497633:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731997952 00000100:00100000:3.0:1788969887.497641:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731997952 00000100:00100000:3.0:1788969887.497683:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 132 00000100:00100000:3.0:1788969887.497689:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:6065:x1875870731997952:12345-192.168.202.9@tcp:502: 00000100:00100000:3.0:1788969887.497995:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:6065:x1875870731997952:12345-192.168.202.9@tcp:502: Request processed in 303us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969887.498003:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 132 00000100:00100000:3.0:1788969887.502456:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969887.502885:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731998080 00000100:00100000:1.0:1788969887.502895:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731998080 00000100:00100000:1.0:1788969887.502960:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 133 00000100:00100000:1.0:1788969887.502969:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:6065:x1875870731998080:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788969887.503255:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:6065:x1875870731998080:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 287us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969887.503262:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 133 00000100:00100000:2.0:1788969887.509278:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969887.510132:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731998208 00000100:00100000:3.0:1788969887.510144:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731998208 00000100:00100000:3.0:1788969887.510209:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 134 00000100:00100000:3.0:1788969887.510218:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5598:x1875870731998208:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969887.510235:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969887.510254:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841544400/0x5d0de860b05b3ae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e7d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.510282:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841544400/0x5d0de860b05b3ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7d9 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.510291:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841544400/0x5d0de860b05b3ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7d9 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969887.510300:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841544400, rc 0) 00000100:00100000:3.0:1788969887.510570:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5598:x1875870731998208:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969887.510579:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 134 00000100:00100000:0.0:1788969887.512292:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969887.512463:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731998336 00000100:00100000:3.0:1788969887.512475:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731998336 00000100:00100000:3.0:1788969887.514754:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 135 00000100:00100000:3.0:1788969887.514777:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5598:x1875870731998336:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969887.518288:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5598:x1875870731998336:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 3512us (5992us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788969887.518322:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 135 00010000:00010000:0.0:1788969887.813145:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788969888.645017:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788969888.645024:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97784c0a0000 from 39 10000000:01000000:2.0:1788969888.645029:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788969888.645070:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.645082:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.645092:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.645113:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741457664:0@lo:101: 00000100:00100000:2.0:1788969888.645183:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969888.646723:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778789529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788969888.648695:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741457664 00000100:00100000:0.0:1788969888.648708:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741457664 00000100:00100000:0.0:1788969888.648771:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788969888.648782:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+12:5829:x1875870741457664:12345-0@lo:101: 00010000:00010000:0.0:1788969888.648818:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969888.648838:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3af0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3ae9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.648865:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3ae9 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.648875:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3ae9 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.648883:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4000, rc 0) 00000100:00100000:0.0:1788969888.649121:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741457664:12345-0@lo:101: Request processed in 341us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969888.649140:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788969888.657183:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741457664:0@lo:101: 00010000:00010000:2.0:1788969888.657208:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.657230:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.657302:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741457792:0@lo:501: 00000100:00100000:2.0:1788969888.657550:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969888.657585:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778789529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969888.657684:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741457792 00000100:00100000:3.0:1788969888.657691:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741457792 00000100:00100000:3.0:1788969888.657727:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788969888.657735:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741457792:12345-0@lo:501: 00000100:00100000:3.0:1788969888.659511:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741457792:12345-0@lo:501: Request processed in 1770us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969888.659523:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788969888.664115:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741457792:0@lo:501: 00000100:00100000:2.0:1788969888.664176:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741457920:0@lo:503: 00000100:00100000:2.0:1788969888.664257:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969888.667170:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778789529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.669528:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741457920 00000100:00100000:1.0:1788969888.669541:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741457920 00000100:00100000:1.0:1788969888.671046:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788969888.671063:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741457920:12345-0@lo:503: 00000100:00100000:1.0:1788969888.671308:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741457920:12345-0@lo:503: Request processed in 251us (7050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.671316:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788969888.674057:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741457920:0@lo:503: 00000100:00100000:2.0:1788969888.675936:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8443:1875870741458048:0@lo:502: 00000100:00100000:2.0:1788969888.676026:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969888.676062:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969888.676247:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741458048 00000100:00100000:3.0:1788969888.676254:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741458048 00000100:00100000:3.0:1788969888.676469:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788969888.676482:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:8443:x1875870741458048:12345-0@lo:502: 00000100:00100000:3.0:1788969888.676736:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:8443:x1875870741458048:12345-0@lo:502: Request processed in 257us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969888.676745:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788969888.676961:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8443:1875870741458048:0@lo:502: 00000100:00100000:2.0:1788969888.677011:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8443:1875870741458176:0@lo:502: 00000100:00100000:2.0:1788969888.677045:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969888.677071:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969888.677152:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741458176 00000100:00100000:3.0:1788969888.677156:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741458176 00000100:00100000:3.0:1788969888.677178:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788969888.677183:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:8443:x1875870741458176:12345-0@lo:502: 00000100:00100000:3.0:1788969888.677287:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:8443:x1875870741458176:12345-0@lo:502: Request processed in 104us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969888.677291:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788969888.677515:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8443:1875870741458176:0@lo:502: 00000040:00080000:2.0:1788969888.677535:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788969888.677666:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788969888.677684:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788969888.677693:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.677715:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969888.677724:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788969888.677727:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788969888.677729:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788969888.677751:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.677758:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.677766:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969888.677776:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741458304:0@lo:101: 00000100:00100000:3.0:1788969888.677818:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969888.677840:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969888.677851:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741458304 00000100:00100000:3.0:1788969888.677854:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741458304 00000100:00100000:3.0:1788969888.677874:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788969888.677880:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+13:5829:x1875870741458304:12345-0@lo:101: 00010000:00010000:3.0:1788969888.677888:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969888.677898:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841544e00/0x5d0de860b05b3afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3af7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.677917:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841544e00/0x5d0de860b05b3afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3af7 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.678092:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841544e00/0x5d0de860b05b3afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3af7 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.678102:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841544e00, rc 0) 00000100:00100000:3.0:1788969888.678133:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741458304:12345-0@lo:101: Request processed in 253us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969888.678139:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788969888.678171:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741458304:0@lo:101: 00010000:00010000:3.0:1788969888.678183:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.678190:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969888.678245:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741458432:0@lo:501: 00000100:00100000:3.0:1788969888.678267:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969888.678280:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.681201:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741458432 00000100:00100000:1.0:1788969888.681215:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741458432 00000100:00100000:1.0:1788969888.681270:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788969888.681279:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741458432:12345-0@lo:501: 00000100:00100000:0.0:1788969888.682115:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741458432:12345-0@lo:501: Request processed in 834us (3843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969888.682124:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788969888.682137:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741458432:0@lo:501: 00000100:00100000:3.0:1788969888.682182:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741458560:0@lo:503: 00000100:00100000:3.0:1788969888.682225:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969888.682262:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788969888.682848:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741458560 00000100:00100000:0.0:1788969888.682854:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741458560 00000100:00100000:0.0:1788969888.682886:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788969888.682894:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741458560:12345-0@lo:503: 00000100:00100000:0.0:1788969888.683114:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741458560:12345-0@lo:503: Request processed in 220us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969888.683122:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788969888.683125:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741458560:0@lo:503: 00000100:00100000:0.0:1788969888.683660:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8444:1875870741458688:0@lo:502: 00000100:00100000:0.0:1788969888.683694:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969888.683751:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778536199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.683784:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741458688 00000100:00100000:1.0:1788969888.684500:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741458688 00000100:00100000:1.0:1788969888.684546:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788969888.684555:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:8444:x1875870741458688:12345-0@lo:502: 00000100:00100000:1.0:1788969888.684737:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:8444:x1875870741458688:12345-0@lo:502: Request processed in 183us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.684744:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788969888.684895:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8444:1875870741458688:0@lo:502: 00000020:01000000:1.0:1788969888.684922:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788969888.684931:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969888.684938:0:8444:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788969888.684944:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788969888.684972:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8444:1875870741458816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969888.685005:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.685041:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778781e8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788969888.685146:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741458816 00000100:00100000:2.0:1788969888.685151:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741458816 00000100:00100000:2.0:1788969888.685185:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788969888.685192:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:8444:x1875870741458816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788969888.685314:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:8444:x1875870741458816:12345-0@lo:502:llog_process_th.0 Request processed in 121us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969888.685321:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788969888.685394:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8444:1875870741458816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788969888.685413:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788969888.685417:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969888.685418:0:8444:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788969888.685422:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788969888.685572:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788969888.685593:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788969888.685602:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.685614:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788969888.685624:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788969888.685627:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9778601fa800 from 39 10000000:01000000:2.0:1788969888.685630:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788969888.685652:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.685661:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.685670:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.685682:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741458944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788969888.685709:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969888.685740:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.685782:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741458944 00000100:00100000:1.0:1788969888.685786:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741458944 00000100:00100000:2.0:1788969888.685927:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788969888.685935:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:5829:x1875870741458944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788969888.685944:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969888.685954:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840031c00/0x5d0de860b05b3b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3b05 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.685973:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840031c00/0x5d0de860b05b3b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3b05 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.685983:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840031c00/0x5d0de860b05b3b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b05 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.685991:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031c00, rc 0) 00000100:00100000:2.0:1788969888.686020:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741458944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969888.686026:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788969888.686055:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741458944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788969888.686067:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.686076:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.686115:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788969888.686137:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969888.686156:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.686187:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741459072 00000100:00100000:1.0:1788969888.686191:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741459072 00000100:00100000:1.0:1788969888.686218:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788969888.686225:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741459072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.686445:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741459072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.686452:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788969888.686481:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.686506:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.686540:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.686553:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778781e80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.686564:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741459200 00000100:00100000:1.0:1788969888.686568:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741459200 00000100:00100000:1.0:1788969888.686586:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788969888.686591:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741459200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.686719:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741459200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.686726:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788969888.686760:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969888.687424:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8445:1875870741459328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969888.687472:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969888.687540:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83180 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.687571:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741459328 00000100:00100000:1.0:1788969888.687576:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741459328 00000100:00100000:1.0:1788969888.687641:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788969888.687648:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:8445:x1875870741459328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969888.687847:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:8445:x1875870741459328:12345-0@lo:502:llog_process_th.0 Request processed in 199us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.687854:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788969888.687934:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8445:1875870741459328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969888.687973:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8445:1875870741459456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969888.688002:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969888.688260:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83180 going to sleep for 11 seconds 00000100:00100000:2.0:1788969888.688285:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741459456 00000100:00100000:2.0:1788969888.688295:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741459456 00000100:00100000:2.0:1788969888.688315:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788969888.688321:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:8445:x1875870741459456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788969888.688551:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:8445:x1875870741459456:12345-0@lo:502:llog_process_th.0 Request processed in 229us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969888.688558:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788969888.688673:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8445:1875870741459456:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788969888.688694:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788969888.688988:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788969888.689009:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788969888.689018:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.689030:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969888.689038:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788969888.689040:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788969888.689043:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788969888.689066:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.689073:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.689092:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969888.689105:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.689136:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.689197:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16780 going to sleep for 11 seconds 00000100:00100000:2.0:1788969888.689229:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741459584 00000100:00100000:2.0:1788969888.689234:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741459584 00000100:00100000:2.0:1788969888.689290:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788969888.689296:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:5829:x1875870741459584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788969888.689305:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969888.689316:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840030a00/0x5d0de860b05b3b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3b13 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.689336:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840030a00/0x5d0de860b05b3b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3b13 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.689346:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840030a00/0x5d0de860b05b3b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b13 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.689372:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030a00, rc 0) 00000100:00100000:2.0:1788969888.689409:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741459584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969888.689416:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788969888.689474:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969888.689486:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.689495:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969888.689532:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969888.689554:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969888.689977:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83180 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.690024:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741459712 00000100:00100000:1.0:1788969888.690028:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741459712 00000100:00100000:1.0:1788969888.690050:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788969888.690056:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741459712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.690280:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741459712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.690287:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788969888.690304:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969888.690483:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969888.690521:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969888.690579:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977853619c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.690608:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741459840 00000100:00100000:1.0:1788969888.690612:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741459840 00000100:00100000:1.0:1788969888.690667:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788969888.690674:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741459840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.690861:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741459840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.690868:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788969888.690924:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741459840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969888.694477:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8446:1875870741459968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969888.694550:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969888.694625:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff977853619c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.694664:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741459968 00000100:00100000:1.0:1788969888.694671:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741459968 00000100:00100000:1.0:1788969888.694743:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788969888.694753:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:8446:x1875870741459968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969888.695052:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:8446:x1875870741459968:12345-0@lo:502:llog_process_th.0 Request processed in 300us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.695065:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788969888.695146:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8446:1875870741459968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788969888.695174:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788969888.695182:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788969888.695189:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788969888.695194:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788969888.695308:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8446:1875870741460096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969888.695471:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969888.695531:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff977853619c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.695562:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741460096 00000100:00100000:1.0:1788969888.695566:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741460096 00000100:00100000:1.0:1788969888.695593:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788969888.695600:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:8446:x1875870741460096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969888.695728:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:8446:x1875870741460096:12345-0@lo:502:llog_process_th.0 Request processed in 127us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.695734:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788969888.695952:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8446:1875870741460096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788969888.695973:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788969888.695982:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969888.695984:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788969888.695989:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788969888.696052:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788969888.696071:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788969888.696079:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.696090:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969888.696100:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788969888.696103:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97786f03a800 from 39 10000000:01000000:1.0:1788969888.696106:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788969888.696129:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.696138:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.696146:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969888.696159:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.696192:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.696328:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788969888.696484:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741460224 00000100:00100000:0.0:1788969888.696489:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741460224 00000100:00100000:0.0:1788969888.696553:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788969888.696561:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741460224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969888.696571:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969888.696582:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff5e00/0x5d0de860b05b3b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3b21 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.696601:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5e00/0x5d0de860b05b3b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3b21 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.696612:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff5e00/0x5d0de860b05b3b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b21 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.696620:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5e00, rc 0) 00000100:00100000:0.0:1788969888.696674:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741460224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969888.696680:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788969888.696738:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788969888.696750:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.696759:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.696838:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788969888.696866:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969888.697703:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70540 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.697741:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741460352 00000100:00100000:1.0:1788969888.697747:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741460352 00000100:00100000:1.0:1788969888.697772:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788969888.697779:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741460352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.699884:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741460352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2098us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.699896:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788969888.700058:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969888.700105:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969888.700145:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969888.700189:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977853619e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.700309:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741460480 00000100:00100000:1.0:1788969888.700316:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741460480 00000100:00100000:1.0:1788969888.700499:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788969888.700507:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741460480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.700668:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741460480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.700674:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788969888.700755:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969888.701244:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8448:1875870741460608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969888.701284:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969888.701316:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.701462:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741460608 00000100:00100000:1.0:1788969888.701468:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741460608 00000100:00100000:1.0:1788969888.701505:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788969888.701512:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:8448:x1875870741460608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969888.701701:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:8448:x1875870741460608:12345-0@lo:502:llog_process_th.0 Request processed in 189us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.701709:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788969888.701857:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8448:1875870741460608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969888.701899:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8448:1875870741460736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969888.702069:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969888.702120:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788969888.702190:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741460736 00000100:00100000:0.0:1788969888.702196:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741460736 00000100:00100000:0.0:1788969888.702471:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788969888.702480:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:8448:x1875870741460736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969888.702680:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:8448:x1875870741460736:12345-0@lo:502:llog_process_th.0 Request processed in 202us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969888.702688:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788969888.702755:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8448:1875870741460736:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788969888.702780:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788969888.703156:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788969888.703178:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788969888.703187:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.703204:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969888.703288:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788969888.703292:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788969888.703295:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788969888.703503:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.703512:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.703521:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969888.703541:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.703580:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.703648:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16000 going to sleep for 11 seconds 00000100:00100000:0.0:1788969888.703680:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741460864 00000100:00100000:0.0:1788969888.703685:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741460864 00000100:00100000:0.0:1788969888.703747:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788969888.703755:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741460864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969888.703766:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969888.703777:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff5200/0x5d0de860b05b3b36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3b2f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.703873:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5200/0x5d0de860b05b3b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3b2f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.703884:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff5200/0x5d0de860b05b3b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b2f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.703893:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5200, rc 0) 00000100:00100000:0.0:1788969888.703928:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741460864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969888.703934:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788969888.704061:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969888.704073:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.704082:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969888.704126:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969888.704146:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969888.704472:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.704501:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741460992 00000100:00100000:1.0:1788969888.704506:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741460992 00000100:00100000:1.0:1788969888.704529:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788969888.704535:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741460992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.704811:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741460992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.704818:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788969888.705041:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741460992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969888.705073:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741461120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969888.705109:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969888.705160:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977880f83cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.705187:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741461120 00000100:00100000:1.0:1788969888.705191:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741461120 00000100:00100000:1.0:1788969888.705306:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788969888.705329:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741461120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.705604:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741461120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 286us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.705611:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788969888.705669:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741461120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969888.707152:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8449:1875870741461248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969888.707207:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.707247:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788969888.707249:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741461248 00000100:00100000:0.0:1788969888.707261:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741461248 00000100:00100000:0.0:1788969888.707299:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788969888.707307:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8449:x1875870741461248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969888.707524:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8449:x1875870741461248:12345-0@lo:502:llog_process_th.0 Request processed in 217us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969888.707531:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788969888.707549:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8449:1875870741461248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788969888.707572:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788969888.707580:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969888.707583:0:8449:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788969888.707588:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788969888.707608:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8449:1875870741461376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969888.707639:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.707662:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788969888.707701:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741461376 00000100:00100000:2.0:1788969888.707706:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741461376 00000100:00100000:2.0:1788969888.707765:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788969888.707772:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8449:x1875870741461376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788969888.708071:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8449:x1875870741461376:12345-0@lo:502:llog_process_th.0 Request processed in 299us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969888.708078:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788969888.708128:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8449:1875870741461376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788969888.708145:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788969888.708149:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969888.708150:0:8449:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788969888.708154:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788969888.708286:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788969888.708306:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788969888.708426:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.708444:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969888.708455:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788969888.708461:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9778652a99c0 from 1 10000000:01000000:0.0:1788969888.708464:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788969888.708488:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.708494:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.708502:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969888.708516:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741461504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788969888.708542:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969888.708573:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778512a8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.708622:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741461504 00000100:00100000:1.0:1788969888.708627:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741461504 00000100:00100000:1.0:1788969888.708686:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788969888.708694:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741461504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788969888.708704:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969888.708714:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b3b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3b3d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.708741:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b3b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3b3d expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.708751:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b3b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b3d expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.708758:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9e00, rc 0) 00000100:00100000:1.0:1788969888.708822:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741461504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.708829:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788969888.708842:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741461504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788969888.708858:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b44 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.708867:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b44 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.708911:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741461632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788969888.708941:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969888.710184:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741461632 00000100:00100000:0.0:1788969888.710194:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741461632 00000100:00100000:2.0:1788969888.710229:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70540 going to sleep for 11 seconds 00000100:00100000:0.0:1788969888.710289:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788969888.710297:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741461632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969888.710960:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741461632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 661us (2015us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788969888.710968:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788969888.711608:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741461632:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788969888.711643:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788969888.711652:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b44 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.711662:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b44 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969888.844867:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788969888.944695:0:8474:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf2306180 20000000:00000080:2.0:1788969888.944714:0:8474:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff977878f73000 uarg=0000000000000000 20000000:01000000:2.0:1788969888.944749:0:8474:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788969888.944755:0:8474:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788969888.944759:0:8474:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788969888.945761:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788969888.946133:0:8474:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788969888.950317:0:8474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788969888.950509:0:8474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788969888.950570:0:8474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788969888.950590:0:8474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788969888.950612:0:8474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.950629:0:8474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff5600/0x5d0de860b05b38c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b38b9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.950637:0:8474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b391b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.950643:0:8474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b39e6 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.950652:0:8474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7a1 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.950660:0:8474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.950699:0:8474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7a1 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.950724:0:8474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7a1 expref: 9 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.950740:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8474:1875870741461760:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788969888.950871:0:8474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b39e6 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.950880:0:8474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b39e6 expref: 18 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.950888:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778539ba940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8474:1875870741461888:0@lo:104: 00000100:00100000:2.0:1788969888.950927:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788969888.951043:0:8474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b391b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.951051:0:8474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b391b expref: 18 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.951059:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8474:1875870741462016:0@lo:104: 00000100:00100000:2.0:1788969888.951083:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788969888.951108:0:8474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff5600/0x5d0de860b05b38c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b38b9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969888.951117:0:8474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977852ff5600/0x5d0de860b05b38c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b38b9 expref: 18 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.951124:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8474:1875870741462144:0@lo:104: 00000100:00100000:2.0:1788969888.951140:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788969888.951303:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788969888.951321:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.951335:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741461888 00000100:00100000:1.0:1788969888.951342:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741461888 00000100:00100000:1.0:1788969888.951456:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741462016 00000100:00100000:1.0:1788969888.951459:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741462016 00000100:00100000:1.0:1788969888.951470:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741462144 00000100:00100000:1.0:1788969888.951472:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741462144 00000100:00100000:1.0:1788969888.951483:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788969888.951490:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:8474:x1875870741461888:12345-0@lo:104: 00010000:00010000:1.0:1788969888.951508:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951561:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788969888.951566:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:8474:x1875870741461888:12345-0@lo:104: Request processed in 77us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.951572:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788969888.951589:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788969888.951595:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:8474:x1875870741462016:12345-0@lo:104: 00010000:00010000:1.0:1788969888.951603:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951633:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788969888.951637:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:8474:x1875870741462016:12345-0@lo:104: Request processed in 43us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.951642:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788969888.951676:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788969888.951683:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:8474:x1875870741462144:12345-0@lo:104: 00010000:00010000:1.0:1788969888.951690:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951713:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788969888.951718:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:8474:x1875870741462144:12345-0@lo:104: Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.951723:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788969888.951740:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788969888.951746:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951759:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788969888.951763:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951770:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788969888.951777:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969888.951782:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788969888.951830:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951838:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788969888.951857:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951863:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b39e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b39ed expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951876:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788969888.951880:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951886:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545200 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788969888.951889:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.951907:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788969888.951913:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969888.951918:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788969888.951931:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952419:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788969888.952485:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952493:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b391b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3922 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952503:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788969888.952506:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952511:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8a00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788969888.952514:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952522:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788969888.952528:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969888.952540:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788969888.952554:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952560:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788969888.952565:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952572:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b38b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b38c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952584:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969888.952586:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969888.952587:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969888.952593:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969888.952610:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741462272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788969888.952641:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.952679:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741462528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788969888.952708:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.952723:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788969888.952728:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741462400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788969888.952742:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969888.952762:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741462272 00000100:00100000:1.0:1788969888.952767:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741462272 00010000:00010000:1.0:1788969888.952786:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b39e6 expref: 19 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969888.952821:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741462528 00000100:00100000:1.0:1788969888.952828:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741462528 00010000:00010000:1.0:1788969888.952841:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff5600/0x5d0de860b05b38c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b38b9 expref: 20 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969888.952852:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741462400 00000100:00100000:1.0:1788969888.952855:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741462400 00010000:00010000:1.0:1788969888.952863:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b391b expref: 21 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969888.952874:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788969888.952880:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+21:3286:x1875870741462272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788969888.952890:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969888.952895:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b39e6 expref: 21 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952903:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b39e6 expref: 21 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.952918:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788969888.953073:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b39ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b39e6 expref: 21 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.953085:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778539ba940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8474:1875870741461888:0@lo:104: 00000100:00100000:2.0:1788969888.953095:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8474:1875870741462016:0@lo:104: 00000100:00100000:2.0:1788969888.953102:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8474:1875870741462144:0@lo:104: 00000100:00100000:1.0:1788969888.953297:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+20:3286:x1875870741462272:12345-0@lo:103:ldlm_bl.0 Request processed in 417us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.953305:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788969888.953319:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788969888.953325:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741462528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788969888.953333:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969888.953337:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff5600/0x5d0de860b05b38c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b38b9 expref: 19 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.953345:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff5600/0x5d0de860b05b38c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b38b9 expref: 19 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.953375:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5600/0x5d0de860b05b38c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b38b9 expref: 19 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.953384:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969888.953420:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3284:x1875870741462528:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.953427:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788969888.953448:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788969888.953454:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d43840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:3284:x1875870741462400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788969888.953461:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969888.953465:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b391b expref: 17 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.953473:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b391b expref: 17 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.953483:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dc600/0x5d0de860b05b3922 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b391b expref: 17 pid: 5825 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.953491:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969888.953508:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d43840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:3284:x1875870741462400:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.953513:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788969888.953624:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741462400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788969888.953631:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741462528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788969888.956487:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741462272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788969888.958429:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a312c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8474:1875870741461760:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788969888.958473:0:8474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969888.958647:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969888.959506:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731998464 00000100:00100000:1.0:1788969888.959534:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731998464 00010000:00010000:1.0:1788969888.959574:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7a1 expref: 10 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969888.959657:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:1.0:1788969888.959668:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2354:x1875870731998464:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788969888.959684:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969888.959690:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7a1 expref: 10 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959702:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7a1 expref: 10 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959720:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840030200/0x5d0de860b05b3aaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7a1 expref: 10 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959736:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959744:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959760:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959780:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959803:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959821:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959827:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788969888.959844:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959852:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959870:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969888.959879:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788969888.959883:0:8474:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.959890:0:8474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969888.959895:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840030800/0x5d0de860b05b3b4b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969888.959930:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:2354:x1875870731998464:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 264us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969888.959937:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:2.0:1788969889.082572:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969889.088297:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731998592 00000100:00100000:0.0:1788969889.088312:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731998592 00000100:00100000:0.0:1788969889.088399:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 168 00000100:00100000:0.0:1788969889.088409:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:5598:x1875870731998592:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969889.088425:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969889.088454:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e7e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969889.088480:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e0 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969889.088491:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e0 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969889.088500:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4c00, rc 0) 00000100:00100000:0.0:1788969889.088554:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5598:x1875870731998592:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 147us (5992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969889.088561:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 168 00000100:00100000:0.0:1788969889.094101:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969889.094148:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731998720 00000100:00100000:0.0:1788969889.094158:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731998720 00000100:00100000:0.0:1788969889.094219:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:0.0:1788969889.094229:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5598:x1875870731998720:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969889.094530:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5598:x1875870731998720:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 301us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969889.094538:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:2.0:1788969889.108699:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969889.108746:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731998848 00000100:00100000:2.0:1788969889.108757:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731998848 00000100:00100000:2.0:1788969889.108826:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 170 00000100:00100000:2.0:1788969889.108838:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5598:x1875870731998848:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788969889.109063:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:5598:x1875870731998848:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 227us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969889.109071:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 170 00000100:00100000:2.0:1788969889.119776:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969889.120861:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731998976 00000100:00100000:3.0:1788969889.120874:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731998976 00000100:00100000:3.0:1788969889.120936:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 171 00000100:00100000:3.0:1788969889.120947:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:6102:x1875870731998976:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788969889.121191:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:6102:x1875870731998976:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 246us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969889.121199:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 171 00000100:00100000:2.0:1788969889.140597:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969889.140640:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731999104 00000100:00100000:2.0:1788969889.140651:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731999104 00000100:00100000:2.0:1788969889.140699:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 172 00000100:00100000:2.0:1788969889.140709:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:6102:x1875870731999104:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788969889.141687:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:6102:x1875870731999104:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 973us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969889.141697:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 172 00000100:00100000:2.0:1788969889.856446:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969889.856482:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969889.856510:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969889.856532:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969889.856557:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731999360 00000100:00100000:2.0:1788969889.856566:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731999360 00000100:00100000:2.0:1788969889.856627:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:1.0:1788969889.856627:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731999488 00000100:00100000:1.0:1788969889.856631:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731999488 00000100:00100000:2.0:1788969889.856637:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870731999360:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969889.856657:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731999616 00000100:00100000:1.0:1788969889.856660:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731999616 00000100:00100000:1.0:1788969889.856673:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1788969889.856678:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2355:x1875870731999488:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969889.856706:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870731999360:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969889.856714:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:2.0:1788969889.856735:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788969889.856742:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788969889.856763:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788969889.856767:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788969889.856770:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969889.856937:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731999232 00000100:00100000:0.0:1788969889.856942:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731999232 00000100:00100000:0.0:1788969889.856976:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 173 00000100:00100000:0.0:1788969889.856984:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870731999232:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969889.857492:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2355:x1875870731999488:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 812us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969889.857499:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1788969889.857511:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:1.0:1788969889.857518:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2355:x1875870731999616:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969889.857550:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2355:x1875870731999616:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 33us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969889.857556:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1788969889.859055:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870731999232:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 2066us (2610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969889.859067:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 173 00010000:00010000:0.0:1788969889.861011:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788969890.373568:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788969890.373574:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97784c0a0000 from 4 10000000:01000000:0.0:1788969890.373578:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788969890.373621:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969890.373632:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969890.373644:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969890.373668:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741462656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788969890.373741:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969890.373820:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788969890.373899:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741462656 00000100:00100000:3.0:1788969890.373907:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741462656 00000100:00100000:3.0:1788969890.373961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788969890.373970:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741462656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969890.373983:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969890.373995:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3b59 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.374019:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3b59 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.374031:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b59 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.374040:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841544a00, rc 0) 00000100:00100000:3.0:1788969890.374081:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741462656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969890.374088:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788969890.374414:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741462656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788969890.374439:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969890.374449:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969890.374502:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d41e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741462784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969890.374529:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969890.374547:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788969890.374855:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741462784 00000100:00100000:0.0:1788969890.374860:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741462784 00000100:00100000:0.0:1788969890.374895:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788969890.374901:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741462784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969890.375135:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741462784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969890.375142:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788969890.375174:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d41e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741462784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969890.375207:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741462912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969890.375241:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969890.375258:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788969890.375267:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741462912 00000100:00100000:0.0:1788969890.375270:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741462912 00000100:00100000:0.0:1788969890.375286:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788969890.375291:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741462912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969890.375416:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741462912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969890.375434:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788969890.375464:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741462912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969890.378151:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8570:1875870741463040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969890.378224:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969890.378267:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788969890.378324:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741463040 00000100:00100000:2.0:1788969890.378331:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741463040 00000100:00100000:2.0:1788969890.378376:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788969890.378386:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:8570:x1875870741463040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788969890.378601:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:8570:x1875870741463040:12345-0@lo:502:llog_process_th.0 Request processed in 217us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969890.378608:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788969890.378709:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8570:1875870741463040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788969890.378740:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788969890.378749:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788969890.378751:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788969890.378757:0:8570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97784c0a0000 00000020:00000080:3.0:1788969890.378760:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788969890.378859:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8570:1875870741463168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969890.384115:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969890.384188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741463168 00000100:00100000:3.0:1788969890.384197:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741463168 00000100:00100000:3.0:1788969890.384247:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788969890.384257:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:8570:x1875870741463168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969890.384497:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:8570:x1875870741463168:12345-0@lo:502:llog_process_th.0 Request processed in 242us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969890.384505:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788969890.384553:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952600 going to sleep for 11 seconds 00000100:00100000:3.0:1788969890.384576:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8570:1875870741463168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788969890.384609:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788969890.384617:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788969890.384619:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788969890.384626:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788969890.389849:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788969890.389888:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788969890.389900:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.389913:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969890.389934:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788969890.389936:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9778601fa800 from 4 10000000:01000000:3.0:1788969890.389940:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788969890.389985:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.389992:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.390003:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969890.390037:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741463296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.390097:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969890.390142:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952600 going to sleep for 11 seconds 00000100:00100000:1.0:1788969890.391992:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741463296 00000100:00100000:1.0:1788969890.392002:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741463296 00000100:00100000:1.0:1788969890.392060:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788969890.392068:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741463296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788969890.392083:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969890.392098:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3b67 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969890.392120:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3b67 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969890.392131:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b67 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969890.392148:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8e00, rc 0) 00000100:00100000:1.0:1788969890.392254:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741463296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969890.392261:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788969890.393631:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741463296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969890.393660:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969890.393671:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969890.393736:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741463424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969890.393777:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969890.394019:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969890.394059:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741463424 00000100:00100000:1.0:1788969890.394064:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741463424 00000100:00100000:1.0:1788969890.394755:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788969890.394765:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741463424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969890.395036:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741463424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969890.395043:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788969890.395118:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741463424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.395152:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741463552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.395189:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969890.395295:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952900 going to sleep for 11 seconds 00000100:00100000:0.0:1788969890.395343:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741463552 00000100:00100000:0.0:1788969890.395348:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741463552 00000100:00100000:0.0:1788969890.395371:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788969890.395377:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741463552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969890.395531:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741463552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969890.395537:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788969890.397283:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741463552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969890.405583:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8577:1875870741463680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969890.405645:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969890.405686:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788969890.405692:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741463680 00000100:00100000:2.0:1788969890.405700:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741463680 00000100:00100000:2.0:1788969890.405752:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788969890.405761:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8577:x1875870741463680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788969890.406045:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8577:x1875870741463680:12345-0@lo:502:llog_process_th.0 Request processed in 283us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969890.406052:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788969890.406325:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8577:1875870741463680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788969890.406351:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788969890.406358:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788969890.406359:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788969890.406364:0:8577:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9778601fa800 00000020:00000080:0.0:1788969890.406365:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788969890.406435:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8577:1875870741463808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969890.406475:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969890.406503:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788969890.406827:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741463808 00000100:00100000:3.0:1788969890.406832:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741463808 00000100:00100000:3.0:1788969890.406859:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788969890.406866:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8577:x1875870741463808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969890.407008:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:8577:x1875870741463808:12345-0@lo:502:llog_process_th.0 Request processed in 142us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969890.407015:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788969890.411328:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8577:1875870741463808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788969890.411375:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788969890.411383:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788969890.411386:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788969890.411390:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788969890.415511:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788969890.415543:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788969890.415555:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.415569:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969890.415579:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788969890.415582:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97786f03a800 from 4 10000000:01000000:3.0:1788969890.415585:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788969890.415619:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.415627:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.415637:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969890.415660:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741463936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.415718:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969890.415774:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778789523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788969890.415817:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741463936 00000100:00100000:1.0:1788969890.415824:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741463936 00000100:00100000:1.0:1788969890.415877:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788969890.415887:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741463936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788969890.415899:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969890.415911:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3b75 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969890.415932:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3b75 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969890.415942:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b75 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969890.415950:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8a00, rc 0) 00000100:00100000:1.0:1788969890.415992:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741463936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969890.415999:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788969890.416906:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741463936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969890.416924:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969890.416934:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969890.416995:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741464064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.417024:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969890.417045:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778789523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969890.417058:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741464064 00000100:00100000:3.0:1788969890.417062:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741464064 00000100:00100000:3.0:1788969890.417085:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788969890.417091:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741464064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.417292:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741464064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969890.417299:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788969890.417328:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741464064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.417348:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741464192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.417378:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969890.417389:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778789523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969890.417399:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741464192 00000100:00100000:3.0:1788969890.417402:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741464192 00000100:00100000:3.0:1788969890.417532:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788969890.417541:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741464192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.417669:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741464192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969890.417675:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788969890.417710:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741464192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969890.418672:0:8582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8582:1875870741464320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969890.418716:0:8582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969890.418740:0:8582:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952900 going to sleep for 11 seconds 00000100:00100000:1.0:1788969890.418778:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741464320 00000100:00100000:1.0:1788969890.418783:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741464320 00000100:00100000:1.0:1788969890.419814:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788969890.419823:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:8582:x1875870741464320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969890.420018:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:8582:x1875870741464320:12345-0@lo:502:llog_process_th.0 Request processed in 195us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969890.420025:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788969890.420132:0:8582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8582:1875870741464320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788969890.420158:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788969890.420166:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788969890.420168:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788969890.420175:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97786f03a800 00000020:00000080:3.0:1788969890.420177:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788969890.420247:0:8582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8582:1875870741464448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969890.420280:0:8582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969890.420302:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741464448 00000100:00100000:3.0:1788969890.420307:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741464448 00000100:00100000:3.0:1788969890.420327:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788969890.420333:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:8582:x1875870741464448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969890.420452:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:8582:x1875870741464448:12345-0@lo:502:llog_process_th.0 Request processed in 117us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969890.420458:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788969890.420493:0:8582:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952900 going to sleep for 11 seconds 00000100:00100000:3.0:1788969890.420504:0:8582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:8582:1875870741464448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788969890.420522:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788969890.420526:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788969890.420528:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788969890.420531:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788969890.421981:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788969890.422002:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788969890.422013:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969890.422025:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969890.888403:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969891.269582:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741464576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788969891.269650:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969891.269726:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741464576 00000100:00100000:0.0:1788969891.269733:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741464576 00000100:00100000:0.0:1788969891.269821:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788969891.269829:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741464576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788969891.269862:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788969891.269907:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741464576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969891.269914:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788969891.269935:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788969891.269963:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97784eb8cb40 x1875870741464576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969891.269992:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741464576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788969891.912730:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969892.294958:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741464704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969892.295024:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969892.295094:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741464704 00000100:00100000:2.0:1788969892.295102:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741464704 00000100:00100000:2.0:1788969892.295150:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788969892.295158:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741464704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788969892.295190:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788969892.295231:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741464704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969892.295237:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788969892.295255:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788969892.295281:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778789b61c0 x1875870741464704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969892.295298:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741464704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969892.295674:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741464832:0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.295705:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969892.295736:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741465344:0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.295758:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969892.295778:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969892.295783:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741464960:0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.295829:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969892.295864:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741465088:0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.295886:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969892.296038:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741464832 00000100:00100000:3.0:1788969892.296044:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741464832 00000100:00100000:3.0:1788969892.296072:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788969892.296078:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741464832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969892.296121:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741464832:12345-0@lo:400:kworker.0 Request processed in 43us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969892.296126:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788969892.296176:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788969892.296182:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741465216:0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.296208:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969892.296244:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741465344 00000100:00100000:2.0:1788969892.296247:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741465344 00000100:00100000:2.0:1788969892.296276:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741464960 00000100:00100000:2.0:1788969892.296279:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741464960 00000100:00100000:2.0:1788969892.296291:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741465088 00000100:00100000:2.0:1788969892.296293:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741465088 00000100:00100000:2.0:1788969892.296309:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788969892.296315:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741465344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.296344:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741465344:12345-0@lo:400:kworker.0 Request processed in 29us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969892.296350:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788969892.296361:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788969892.296366:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741464960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.296393:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741464960:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969892.296399:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788969892.296420:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788969892.296427:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741465088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.296458:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741465088:12345-0@lo:400:kworker.0 Request processed in 32us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969892.296464:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788969892.296498:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741464960:0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.296514:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741464832:0@lo:400:kworker.0 00000100:00100000:2.0:1788969892.296524:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741465344:0@lo:400:kworker.0 00000100:00080000:2.0:1788969892.296547:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969892.296564:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741465088:0@lo:400:kworker.0 00000100:00100000:3.0:1788969892.296613:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741465216 00000100:00100000:3.0:1788969892.296617:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741465216 00000100:00100000:3.0:1788969892.296650:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788969892.296657:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741465216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969892.296689:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741465216:12345-0@lo:400:kworker.0 Request processed in 32us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969892.296694:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788969892.301057:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977855cea1c0 x1875870741465216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969892.301078:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741465216:0@lo:400:kworker.0 00010000:00010000:1.0:1788969892.939162:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788969893.927173:0:8779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788969893.957068:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969894.983696:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969894.983741:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969894.983767:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969894.983807:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969894.983837:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732000000 00000100:00100000:1.0:1788969894.983857:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732000000 00000100:00080000:2.0:1788969894.983895:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788969894.983920:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732000128 00000100:00100000:2.0:1788969894.983924:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732000128 00000100:00100000:1.0:1788969894.983929:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:1.0:1788969894.983938:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732000000:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969894.983965:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:2.0:1788969894.983971:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732000128:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969894.984069:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732000000:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 66us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969894.984077:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:1.0:1788969894.984101:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731999872 00000100:00100000:1.0:1788969894.984105:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731999872 00000100:00100000:1.0:1788969894.984136:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:1.0:1788969894.984143:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870731999872:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969894.984298:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870731999744 00000100:00100000:3.0:1788969894.984303:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870731999744 00000100:00100000:3.0:1788969894.984329:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 190 00000100:00100000:3.0:1788969894.984334:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2354:x1875870731999744:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969894.987353:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732000128:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 3370us (3532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969894.987367:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00080000:2.0:1788969894.987433:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788969894.987439:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788969894.994836:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870731999872:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 10681us (11054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969894.994863:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:3.0:1788969894.996996:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2354:x1875870731999744:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 12445us (13095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969894.997012:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 190 00010000:00010000:1.0:1788969895.007622:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969896.006597:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969896.390304:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969896.390337:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741465472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969896.390445:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969896.390569:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741465472 00000100:00100000:1.0:1788969896.390580:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741465472 00000100:00100000:1.0:1788969896.390662:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788969896.390674:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741465472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788969896.390719:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969896.390780:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741465472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969896.390816:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788969896.391112:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d40000 x1875870741465472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969896.391135:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741465472:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788969896.391224:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788969897.045157:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969897.413155:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741465600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788969897.413224:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969897.413322:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741465600 00000100:00100000:1.0:1788969897.413330:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741465600 00000100:00100000:1.0:1788969897.413401:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788969897.413410:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741465600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788969897.413573:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788969897.414928:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741465856:0@lo:400:kworker.0 00000100:00100000:2.0:1788969897.414987:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969897.415019:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969897.415025:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741465984:0@lo:400:kworker.0 00000100:00100000:2.0:1788969897.415045:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969897.415080:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741465856 00000100:00100000:2.0:1788969897.415086:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741465856 00000100:00100000:2.0:1788969897.415130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741465984 00000100:00100000:2.0:1788969897.415134:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741465984 00000100:00100000:2.0:1788969897.415157:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788969897.415164:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741465856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969897.415208:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741465856:12345-0@lo:400:kworker.0 Request processed in 44us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969897.415214:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788969897.415230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788969897.415236:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f482d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741465984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969897.415261:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f482d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741465984:12345-0@lo:400:kworker.0 Request processed in 26us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969897.415266:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788969897.415414:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741465984:0@lo:400:kworker.0 00000100:00100000:2.0:1788969897.415493:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741465856:0@lo:400:kworker.0 00000100:00100000:3.0:1788969897.415829:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741465728:0@lo:400:kworker.0 00000100:00100000:3.0:1788969897.415867:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969897.415894:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f4803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741466240:0@lo:400:kworker.0 00000100:00100000:3.0:1788969897.415929:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969897.415946:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788969897.416047:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741466112:0@lo:400:kworker.0 00000100:00100000:3.0:1788969897.416078:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969897.416107:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741465728 00000100:00100000:3.0:1788969897.416111:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741465728 00000100:00100000:3.0:1788969897.416136:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788969897.416143:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741465728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969897.416176:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741465728:12345-0@lo:400:kworker.0 Request processed in 34us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969897.416182:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788969897.416209:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741466112 00000100:00100000:3.0:1788969897.416212:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741466112 00000100:00100000:3.0:1788969897.416233:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788969897.416238:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ceb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741466112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969897.416266:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ceb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741466112:12345-0@lo:400:kworker.0 Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969897.416272:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788969897.416561:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741466240 00000100:00100000:2.0:1788969897.416565:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741466240 00000100:00100000:2.0:1788969897.416596:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788969897.416602:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741466240:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788969897.416644:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778789b43c0 x1875870741466112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969897.416655:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741466112:0@lo:400:kworker.0 00000100:00100000:2.0:1788969897.417314:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741466240:12345-0@lo:400:kworker.0 Request processed in 710us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969897.417322:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788969897.417538:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741465728:0@lo:400:kworker.0 00000100:00100000:3.0:1788969897.417551:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f4803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741466240:0@lo:400:kworker.0 00000100:00100000:1.0:1788969897.417604:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741465600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4194us (4379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969897.417613:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788969897.417634:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788969897.417639:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788969897.419050:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778789b7480 x1875870741465600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969897.419072:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741465600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788969898.053419:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788969899.012742:0:9022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing yml_node 00010000:00010000:1.0:1788969899.076929:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969900.093280:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969900.093322:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969900.093367:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969900.093397:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969900.093427:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732000384 00000100:00100000:0.0:1788969900.093436:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732000384 00000100:00100000:0.0:1788969900.093498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:0.0:1788969900.093508:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732000384:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969900.093574:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732000384:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969900.093580:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:0.0:1788969900.093603:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732000512 00000100:00100000:0.0:1788969900.093607:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732000512 00000100:00100000:0.0:1788969900.093629:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732000640 00000100:00100000:0.0:1788969900.093631:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732000640 00000100:00100000:0.0:1788969900.093649:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:0.0:1788969900.093671:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732000512:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969900.093695:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732000512:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 27us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969900.093700:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:0.0:1788969900.093712:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:0.0:1788969900.093717:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732000640:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969900.093735:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732000640:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 19us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969900.093740:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00080000:0.0:1788969900.093757:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788969900.093760:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788969900.093763:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969900.094095:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732000256 00000100:00100000:3.0:1788969900.094105:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732000256 00000100:00100000:3.0:1788969900.094139:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 192 00000100:00100000:3.0:1788969900.094145:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2354:x1875870732000256:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969900.094175:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2354:x1875870732000256:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 31us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969900.094182:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 192 00010000:00010000:0.0:1788969900.105121:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969901.125134:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969901.509991:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741466368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969901.510064:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969901.510381:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741466368 00000100:00100000:1.0:1788969901.510389:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741466368 00000100:00100000:1.0:1788969901.510458:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788969901.510467:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f481e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741466368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788969901.510500:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969901.510555:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f481e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741466368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969901.510571:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788969901.510739:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d40000 x1875870741466368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969901.510756:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741466368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788969901.510852:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788969902.151439:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969902.534179:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741466880:0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.534250:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969902.534303:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788969902.534344:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741466496:0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.534372:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969902.534396:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741467008:0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.534421:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969902.534448:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741466752:0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.534469:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969902.534484:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788969902.534488:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741466624:0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.534505:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969902.534516:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741467136:0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.534532:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969902.534556:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741466496 00000100:00100000:3.0:1788969902.534571:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741466496 00000100:00100000:3.0:1788969902.534614:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788969902.534622:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741466496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.534666:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741466496:12345-0@lo:400:kworker.0 Request processed in 45us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969902.534673:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788969902.534702:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741467008 00000100:00100000:3.0:1788969902.534705:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741467008 00000100:00100000:3.0:1788969902.534733:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741466752 00000100:00100000:3.0:1788969902.534736:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741466752 00000100:00100000:3.0:1788969902.534749:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741466624 00000100:00100000:3.0:1788969902.534752:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741466624 00000100:00100000:3.0:1788969902.534764:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788969902.534769:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741467008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.534840:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741467008:12345-0@lo:400:kworker.0 Request processed in 70us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969902.534847:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788969902.534861:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788969902.534867:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741466752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.534966:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741466752:12345-0@lo:400:kworker.0 Request processed in 100us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969902.534973:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788969902.534985:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788969902.534990:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852ceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741466624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.535013:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852ceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741466624:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969902.535018:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788969902.535062:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741466624:0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.535071:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741466752:0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.535096:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741466496:0@lo:400:kworker.0 00000100:00100000:3.0:1788969902.535105:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741467008:0@lo:400:kworker.0 00000100:00100000:0.0:1788969902.536189:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741466880 00000100:00100000:0.0:1788969902.536199:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741466880 00000100:00100000:0.0:1788969902.536239:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741467136 00000100:00100000:0.0:1788969902.536242:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741467136 00000100:00100000:0.0:1788969902.536271:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788969902.536278:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741466880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969902.536350:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741466880:12345-0@lo:400:kworker.0 Request processed in 72us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969902.536356:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788969902.536372:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788969902.536378:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741467136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969902.536414:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741467136:12345-0@lo:400:kworker.0 Request processed in 36us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969902.536431:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788969902.536458:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788969902.536462:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788969902.536493:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cecb40 x1875870741467136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969902.536507:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741467136:0@lo:400:kworker.0 00010000:00080000:0.0:1788969902.536534:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cec000 x1875870741466880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969902.536543:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741466880:0@lo:400:kworker.0 00000100:00100000:2.0:1788969902.541086:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788969902.541110:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741467264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969902.541186:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969902.541274:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741467264 00000100:00100000:1.0:1788969902.541283:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741467264 00000100:00100000:1.0:1788969902.541346:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788969902.541356:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f483c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741467264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788969902.541389:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969902.541440:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f483c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741467264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969902.541447:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788969902.541483:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d42d00 x1875870741467264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969902.541501:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741467264:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788969902.662415:0:9215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.42 00010000:00010000:1.0:1788969903.181546:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969904.196992:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788969904.862629:0:9312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.42 00000100:00100000:2.0:1788969905.216352:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969905.216423:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969905.216454:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969905.216481:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969905.216509:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732001024 00000100:00100000:2.0:1788969905.216518:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732001024 00000100:00100000:2.0:1788969905.216574:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732001152 00000100:00100000:2.0:1788969905.216577:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732001152 00000100:00100000:2.0:1788969905.216596:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788969905.216606:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2352:x1875870732001024:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:2.0:1788969905.216643:0:8534:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3ab8 00000100:00080000:2.0:1788969905.216652:0:8534:0:(import.c:65:import_set_state_nolock()) ffff97787f49a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788969905.216690:0:8534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788969905.217201:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+2:2352:x1875870732001024:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 595us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969905.217210:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788969905.217678:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1788969905.217688:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2352:x1875870732001152:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:2.0:1788969905.217706:0:8534:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3abf 00000100:00080000:2.0:1788969905.217713:0:8534:0:(import.c:65:import_set_state_nolock()) ffff97787f49e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788969905.217738:0:8534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788969905.217892:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732000896 00000100:00100000:3.0:1788969905.217898:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732000896 00000100:00100000:3.0:1788969905.217946:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:3.0:1788969905.217954:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f482940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732000896:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969905.217990:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f482940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732000896:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 38us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969905.217997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:2.0:1788969905.218270:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+2:2352:x1875870732001152:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 583us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969905.218279:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00080000:2.0:1788969905.218314:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788969905.218331:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788969905.218333:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788969905.218345:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969905.219031:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969905.222110:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732000768 00000100:00100000:0.0:1788969905.222125:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732000768 00000100:00100000:0.0:1788969905.222198:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 194 00000100:00100000:0.0:1788969905.222207:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870732000768:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969905.222292:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870732000768:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 77us (5938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969905.222300:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 194 00010000:00010000:2.0:1788969905.230094:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969906.245060:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969906.629992:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788969906.630016:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741467392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969906.630081:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969906.630369:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741467392 00000100:00100000:1.0:1788969906.630378:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741467392 00000100:00100000:1.0:1788969906.630445:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788969906.630455:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741467392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788969906.630490:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969906.630565:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741467392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969906.630572:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788969906.630812:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d42d00 x1875870741467392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969906.630832:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741467392:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788969906.630890:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788969907.282455:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788969907.330712:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:1.0:1788969907.330722:0:6702:0:(genops.c:885:class_export_put()) final put ffff97787f49c800/c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:2.0:1788969907.333428:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f49c800/c7778032-abf5-4f7d-b43e-a87bfd7b090c for lustre-OST0000 00000020:00000080:2.0:1788969907.333493:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f49a000 for lustre-OST0000 00000100:00100000:2.0:1788969907.655057:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969907.655089:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741467520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969907.655185:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969907.655316:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741467520 00000100:00100000:1.0:1788969907.655328:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741467520 00000100:00100000:1.0:1788969907.655428:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788969907.655548:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f482580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741467520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788969907.655600:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969907.655666:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f482580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741467520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 228us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969907.655674:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788969907.656140:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f480f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741467776:0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.656153:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f481a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741467648:0@lo:400:kworker.0 00000100:00100000:2.0:1788969907.656184:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969907.656234:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f480b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741468032:0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.656236:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969907.656303:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969907.656312:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741468160:0@lo:400:kworker.0 00000100:00100000:2.0:1788969907.656333:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788969907.656346:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741467904:0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.656354:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969907.656387:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969907.656437:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741467776 00010000:00080000:3.0:1788969907.656445:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d40000 x1875870741467520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969907.656446:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741467776 00000100:00100000:3.0:1788969907.656476:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741467520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969907.656494:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741468160 00000100:00100000:2.0:1788969907.656499:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741468160 00000100:00080000:3.0:1788969907.656505:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788969907.656511:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969907.656537:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741467904 00000100:00100000:3.0:1788969907.656538:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741467648 00000100:00100000:2.0:1788969907.656543:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741467904 00000100:00100000:3.0:1788969907.656547:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741467648 00000100:00100000:2.0:1788969907.656579:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788969907.656590:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741467776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.656611:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788969907.656625:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741467648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969907.656665:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741467776:12345-0@lo:400:kworker.0 Request processed in 76us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969907.656676:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788969907.656697:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741467648:12345-0@lo:400:kworker.0 Request processed in 75us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969907.656703:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788969907.656717:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788969907.656720:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741468160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.656758:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741468032 00000100:00100000:3.0:1788969907.657268:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741468032 00000100:00100000:3.0:1788969907.657385:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788969907.657394:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741468032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.657442:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741468032:12345-0@lo:400:kworker.0 Request processed in 49us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969907.657449:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788969907.657472:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788969907.657480:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741467904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.657510:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741467904:12345-0@lo:400:kworker.0 Request processed in 32us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969907.657516:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788969907.657539:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969907.657561:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f481a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741467648:0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.657599:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741467904:0@lo:400:kworker.0 00010000:00080000:3.0:1788969907.657614:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787f480b40 x1875870741468032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969907.657625:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f480b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741468032:0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.657668:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f480f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741467776:0@lo:400:kworker.0 00000100:00100000:3.0:1788969907.659540:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741468160:12345-0@lo:400:kworker.0 Request processed in 2819us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969907.659552:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788969907.664661:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741468160:0@lo:400:kworker.0 00000001:02000400:1.0:1788969907.759998:0:9412:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.42 00010000:00010000:3.0:1788969908.293018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788969909.265538:0:9462:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 9 12:05:08 EDT 2026 00010000:00010000:2.0:1788969909.318611:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788969909.319448:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:2.0:1788969909.319455:0:7615:0:(genops.c:885:class_export_put()) final put ffff97787f49b800/c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:2.0:1788969909.319484:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f49b800/c7778032-abf5-4f7d-b43e-a87bfd7b090c for lustre-OST0001 00000020:00000080:2.0:1788969909.322477:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f49e000 for lustre-OST0001 00000100:00100000:2.0:1788969910.338963:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969910.339009:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969910.339146:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732001408 00000100:00100000:0.0:1788969910.339157:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732001408 00000100:00100000:0.0:1788969910.340622:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:0.0:1788969910.340635:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732001408:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969910.340718:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732001408:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 85us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969910.340725:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:3.0:1788969910.341613:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732001280 00000100:00100000:3.0:1788969910.341623:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732001280 00000100:00100000:3.0:1788969910.341659:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 196 00000100:00100000:3.0:1788969910.341667:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2354:x1875870732001280:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969910.341705:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2354:x1875870732001280:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 39us (2751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969910.341711:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 196 00010000:00010000:3.0:1788969910.341800:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788969910.343813:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788969911.366111:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969911.750088:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741468288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969911.750177:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969911.750369:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741468288 00000100:00100000:1.0:1788969911.750378:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741468288 00000100:00100000:1.0:1788969911.750443:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788969911.750453:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741468288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788969911.750489:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969911.750541:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741468288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969911.750548:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788969911.750593:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d40000 x1875870741468288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969911.750614:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741468288:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788969911.752414:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788969912.389027:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969912.773437:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741468544:0@lo:400:kworker.0 00000100:00100000:3.0:1788969912.773507:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969912.773559:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f480f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741469056:0@lo:400:kworker.0 00000100:00100000:3.0:1788969912.773585:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969912.773618:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788969912.773625:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741468416:0@lo:400:kworker.0 00000100:00100000:3.0:1788969912.773652:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969912.773673:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741468928:0@lo:400:kworker.0 00000100:00100000:3.0:1788969912.773695:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969912.773952:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741468544 00000100:00100000:0.0:1788969912.773961:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741468544 00000100:00100000:0.0:1788969912.774004:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741468928 00000100:00100000:0.0:1788969912.774008:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741468928 00000100:00100000:0.0:1788969912.774036:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788969912.774044:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f480b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741468544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.774108:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f480b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741468544:12345-0@lo:400:kworker.0 Request processed in 64us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969912.774114:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788969912.774130:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788969912.774137:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f481a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741468928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.774165:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f481a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741468928:12345-0@lo:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969912.774170:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788969912.774189:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f483840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741468800:0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.774223:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969912.774243:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788969912.774250:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741468672:0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.774270:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969912.774296:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741468672 00000100:00100000:0.0:1788969912.774300:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741468672 00000100:00100000:0.0:1788969912.774335:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788969912.774341:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741468672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.774376:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741468672:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969912.774381:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788969912.774396:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969912.774411:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741469056 00000100:00100000:0.0:1788969912.774414:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741469056 00000100:00100000:0.0:1788969912.774441:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741468800 00000100:00100000:0.0:1788969912.774444:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741468800 00000100:00100000:0.0:1788969912.774461:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788969912.774467:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f481680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741469056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.774499:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f481680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741469056:12345-0@lo:400:kworker.0 Request processed in 32us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969912.774504:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788969912.774515:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788969912.774520:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741468800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.774548:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741468800:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969912.774553:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788969912.774571:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788969912.774598:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741468672:0@lo:400:kworker.0 00010000:00080000:0.0:1788969912.774611:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787f483840 x1875870741468800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969912.774622:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f483840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741468800:0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.774663:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741468416 00000100:00100000:0.0:1788969912.774673:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741468416 00000100:00100000:0.0:1788969912.774699:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788969912.774705:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741468416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.774754:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741468416:12345-0@lo:400:kworker.0 Request processed in 49us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969912.774761:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788969912.777355:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741468416:0@lo:400:kworker.0 00000100:00100000:3.0:1788969912.777379:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741468928:0@lo:400:kworker.0 00000100:00100000:3.0:1788969912.777391:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741468544:0@lo:400:kworker.0 00010000:00080000:3.0:1788969912.777426:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787f480f00 x1875870741469056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969912.777436:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f480f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741469056:0@lo:400:kworker.0 00000100:00100000:0.0:1788969912.778573:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741469184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788969912.778639:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969912.778689:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741469184 00000100:00100000:0.0:1788969912.778696:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741469184 00000100:00100000:0.0:1788969912.780327:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788969912.780341:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741469184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788969912.780377:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788969912.780451:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741469184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969912.780458:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788969912.782377:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778789b6940 x1875870741469184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969912.782403:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741469184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788969913.413030:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969914.439162:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969915.449130:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969915.449207:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969915.449250:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732001536 00000100:00100000:0.0:1788969915.449259:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732001536 00000100:00100000:0.0:1788969915.449303:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 198 00000100:00100000:0.0:1788969915.449311:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2354:x1875870732001536:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969915.449375:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732001664 00000100:00100000:1.0:1788969915.449379:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732001664 00000100:00100000:0.0:1788969915.449385:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2354:x1875870732001536:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 74us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969915.449392:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 198 00000100:00100000:1.0:1788969915.449439:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:1.0:1788969915.449446:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732001664:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969915.449476:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732001664:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969915.449482:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00080000:0.0:1788969915.449538:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788969915.464515:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969916.487205:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969916.869637:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788969916.885589:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741469312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788969916.886118:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969916.898970:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741469312 00000100:00100000:2.0:1788969916.898993:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741469312 00000100:00100000:2.0:1788969916.899093:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788969916.899106:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f480f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741469312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788969916.899160:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788969916.899354:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788969916.899847:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f480f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741469312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 742us (13728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969916.899858:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788969916.900055:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d40000 x1875870741469312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969916.900083:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741469312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788969917.508999:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969917.893209:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788969917.893244:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741469440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788969917.893343:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969917.893617:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741469440 00000100:00100000:1.0:1788969917.893627:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741469440 00000100:00100000:1.0:1788969917.893721:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788969917.893732:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f483840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741469440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788969917.893778:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969917.893863:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f483840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741469440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969917.893871:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788969917.893927:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787f480000 x1875870741469440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969917.894080:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741469440:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788969917.894176:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788969917.894445:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741469696:0@lo:400:kworker.0 00000100:00100000:0.0:1788969917.894490:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969917.894518:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969917.894525:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741469824:0@lo:400:kworker.0 00000100:00100000:0.0:1788969917.894548:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969917.894590:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741469696 00000100:00100000:0.0:1788969917.894596:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741469696 00000100:00100000:0.0:1788969917.894631:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741469824 00000100:00100000:0.0:1788969917.894635:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741469824 00000100:00100000:0.0:1788969917.894673:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788969917.894683:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741469696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969917.894728:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741469696:12345-0@lo:400:kworker.0 Request processed in 46us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969917.894735:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788969917.894750:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788969917.894757:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741469824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969917.894784:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741469824:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969917.894818:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788969917.894846:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969917.894869:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741469824:0@lo:400:kworker.0 00000100:00100000:0.0:1788969917.894900:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741469696:0@lo:400:kworker.0 00000100:00100000:3.0:1788969917.895198:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741469952:0@lo:400:kworker.0 00000100:00100000:3.0:1788969917.895236:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969917.895265:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788969917.895271:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741469568:0@lo:400:kworker.0 00000100:00100000:3.0:1788969917.895303:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969917.895325:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741470080:0@lo:400:kworker.0 00000100:00100000:3.0:1788969917.895348:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969917.895538:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741469952 00000100:00100000:0.0:1788969917.895544:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741469952 00000100:00100000:0.0:1788969917.895588:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788969917.895597:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741469952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969917.895643:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741469952:12345-0@lo:400:kworker.0 Request processed in 48us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969917.895649:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788969917.900838:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741470080 00000100:00100000:1.0:1788969917.900862:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741470080 00000100:00100000:1.0:1788969917.901098:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788969917.901112:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741470080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969917.901248:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741470080:12345-0@lo:400:kworker.0 Request processed in 139us (5897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969917.901256:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788969917.901744:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969917.901820:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741470080:0@lo:400:kworker.0 00010000:00080000:0.0:1788969917.901842:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cecb40 x1875870741469952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969917.901855:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741469952:0@lo:400:kworker.0 00000100:00100000:0.0:1788969917.901889:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741469568 00000100:00100000:0.0:1788969917.901894:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741469568 00000100:00100000:0.0:1788969917.901940:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788969917.902294:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741469568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969917.902373:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741469568:12345-0@lo:400:kworker.0 Request processed in 85us (7068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969917.902380:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788969917.902477:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741469568:0@lo:400:kworker.0 00010000:00010000:3.0:1788969918.535328:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969919.560838:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969920.580181:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969920.580247:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969920.580316:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732001920 00000100:00100000:0.0:1788969920.580331:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732001920 00000100:00100000:0.0:1788969920.580453:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1788969920.580465:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732001920:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969920.580569:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732001920:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 106us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969920.580594:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1788969920.580624:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732001792 00000100:00100000:0.0:1788969920.580627:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732001792 00000100:00080000:1.0:1788969920.580665:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969920.580665:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 200 00000100:00100000:0.0:1788969920.580672:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2353:x1875870732001792:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969920.580712:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2353:x1875870732001792:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969920.580720:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 200 00010000:00010000:0.0:1788969920.583822:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969921.605469:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969921.993884:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741470208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788969921.993984:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969921.996917:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741470208 00000100:00100000:1.0:1788969921.996937:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741470208 00000100:00100000:1.0:1788969921.997025:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788969921.997037:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741470208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788969921.997089:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969921.997206:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741470208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969921.997214:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788969921.997278:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d42d00 x1875870741470208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969921.997303:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741470208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788969921.997398:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788969922.629014:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969923.013232:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741470592:0@lo:400:kworker.0 00000100:00100000:0.0:1788969923.013278:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741470720:0@lo:400:kworker.0 00000100:00100000:3.0:1788969923.013303:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969923.013306:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969923.013364:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741470336:0@lo:400:kworker.0 00000100:00100000:1.0:1788969923.014357:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741470720 00000100:00100000:1.0:1788969923.014365:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741470720 00000100:00100000:1.0:1788969923.014422:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788969923.014430:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741470720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969923.015507:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788969923.015520:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741470464:0@lo:400:kworker.0 00000100:00100000:3.0:1788969923.015562:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969923.015589:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741470976:0@lo:400:kworker.0 00000100:00100000:3.0:1788969923.015614:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969923.015648:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741470592 00000100:00100000:3.0:1788969923.015653:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741470592 00000100:00100000:3.0:1788969923.015687:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741470464 00000100:00100000:3.0:1788969923.015690:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741470464 00000100:00100000:3.0:1788969923.015709:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788969923.015717:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741470592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969923.015758:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741470592:12345-0@lo:400:kworker.0 Request processed in 42us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969923.015765:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788969923.015781:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788969923.015802:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741470464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969923.015829:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741470464:12345-0@lo:400:kworker.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969923.015835:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788969923.015884:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741470976 00000100:00100000:3.0:1788969923.015887:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741470976 00000100:00100000:3.0:1788969923.015912:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788969923.015918:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741470976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969923.015960:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741470976:12345-0@lo:400:kworker.0 Request processed in 42us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969923.015965:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788969923.016002:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741471104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788969923.016040:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969923.016083:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741470464:0@lo:400:kworker.0 00010000:00080000:3.0:1788969923.016095:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787857f840 x1875870741470976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969923.016105:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741470976:0@lo:400:kworker.0 00000100:00100000:3.0:1788969923.016123:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741470592:0@lo:400:kworker.0 00000100:00100000:3.0:1788969923.016151:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741471104 00000100:00100000:3.0:1788969923.016154:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741471104 00000100:00100000:3.0:1788969923.016179:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788969923.016186:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741471104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788969923.016212:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969923.016244:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741471104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969923.016249:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788969923.016270:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787857d680 x1875870741471104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969923.016283:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741471104:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788969923.017022:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788969923.017028:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788969923.017030:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788969923.021157:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969923.021221:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741470848:0@lo:400:kworker.0 00000100:00100000:0.0:1788969923.021226:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741470336 00000100:00100000:0.0:1788969923.021234:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741470336 00000100:00100000:2.0:1788969923.021260:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969923.021279:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788969923.021287:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741470336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969923.021304:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741470848 00000100:00100000:2.0:1788969923.021308:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741470848 00000100:00100000:2.0:1788969923.021344:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788969923.021344:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741470336:12345-0@lo:400:kworker.0 Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969923.021349:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741470848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969923.021351:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788969923.021378:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741470848:12345-0@lo:400:kworker.0 Request processed in 29us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969923.021384:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788969923.021387:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969923.021418:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741470336:0@lo:400:kworker.0 00000100:00100000:0.0:1788969923.021431:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741470848:0@lo:400:kworker.0 00000100:00100000:1.0:1788969923.028559:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741470720:12345-0@lo:400:kworker.0 Request processed in 14121us (15243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969923.028574:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788969923.028638:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787857e1c0 x1875870741470720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969923.028655:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741470720:0@lo:400:kworker.0 00010000:00010000:1.0:1788969923.653644:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969924.677448:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969925.699407:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969925.699463:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969925.699564:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732002048 00000100:00100000:2.0:1788969925.699574:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732002048 00000100:00100000:2.0:1788969925.699642:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 202 00000100:00100000:2.0:1788969925.699662:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870732002048:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969925.699750:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870732002048:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 99us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969925.699765:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 202 00000100:00100000:3.0:1788969925.701080:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732002176 00000100:00100000:3.0:1788969925.701123:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732002176 00000100:00100000:3.0:1788969925.701254:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:3.0:1788969925.701263:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732002176:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969925.701324:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732002176:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 62us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969925.701332:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00080000:1.0:1788969925.701503:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788969925.701513:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788969926.640053:0:10092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:05:25 (1788969925) === 00010000:00010000:0.0:1788969926.731837:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969927.110270:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788969927.110294:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741471232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969927.110365:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969927.110528:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741471232 00000100:00100000:3.0:1788969927.110536:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741471232 00000100:00100000:3.0:1788969927.110613:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788969927.110623:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741471232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788969927.110666:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969927.110712:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741471232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969927.110718:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788969927.111337:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880d42d00 x1875870741471232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969927.111358:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741471232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788969927.111557:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788969927.177543:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969927.177775:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732002304 00000100:00100000:2.0:1788969927.177823:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732002304 00000100:00100000:2.0:1788969927.177885:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 203 00000100:00100000:2.0:1788969927.177896:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:8122:x1875870732002304:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788969927.177914:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969927.177933:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840030800/0x5d0de860b05b3b83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e7e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969927.177961:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840030800/0x5d0de860b05b3b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e7 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969927.177985:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840030800/0x5d0de860b05b3b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e7 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969927.178203:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030800, rc 0) 00000100:00100000:2.0:1788969927.178272:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8122:x1875870732002304:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 377us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969927.178279:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 203 00000100:00100000:0.0:1788969927.202956:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969927.203705:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732002432 00000100:00100000:2.0:1788969927.203716:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732002432 00000100:00100000:2.0:1788969927.203785:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 204 00000100:00100000:2.0:1788969927.203833:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8122:x1875870732002432:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788969927.204359:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8122:x1875870732002432:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 527us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969927.204378:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 204 00000100:00100000:1.0:1788969927.207389:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969927.207482:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732002560 00000100:00100000:0.0:1788969927.207493:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732002560 00000100:00100000:0.0:1788969927.207552:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 205 00000100:00100000:0.0:1788969927.207584:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8122:x1875870732002560:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788969927.208300:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8122:x1875870732002560:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 725us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969927.208311:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 205 00000100:00100000:1.0:1788969927.213561:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969927.214007:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732002688 00000100:00100000:0.0:1788969927.214017:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732002688 00000100:00100000:0.0:1788969927.214236:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 206 00000100:00100000:0.0:1788969927.214248:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8126:x1875870732002688:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788969927.214527:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8126:x1875870732002688:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 281us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969927.214535:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 206 00000100:00100000:1.0:1788969927.276588:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969927.276764:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732002816 00000100:00100000:2.0:1788969927.276774:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732002816 00000100:00100000:2.0:1788969927.276874:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 207 00000100:00100000:2.0:1788969927.276883:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8126:x1875870732002816:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788969927.277201:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8126:x1875870732002816:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 318us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969927.277209:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 207 00000100:00100000:1.0:1788969927.283150:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969927.283429:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732002944 00000100:00100000:0.0:1788969927.283440:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732002944 00000100:00100000:0.0:1788969927.283502:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 208 00000100:00100000:0.0:1788969927.283511:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:8122:x1875870732002944:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788969927.283529:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969927.283548:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3b8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e811 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969927.283597:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e811 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969927.283608:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e811 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969927.283623:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5400, rc 0) 00000100:00100000:0.0:1788969927.283686:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:8122:x1875870732002944:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 175us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969927.283692:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 208 00000100:00100000:1.0:1788969927.288110:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969927.288464:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732003072 00000100:00100000:0.0:1788969927.288475:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732003072 00000100:00100000:0.0:1788969927.288536:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 209 00000100:00100000:0.0:1788969927.288545:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:8122:x1875870732003072:12345-192.168.202.9@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788969927.288591:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788969927.288625:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788969927.288629:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788969927.288632:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788969927.288635:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788969927.298445:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:8122:x1875870732003072:12345-192.168.202.9@tcp:256:mount.lustre.0 Request processed in 9888us (10332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969927.298470:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 209 00000100:00100000:1.0:1788969927.303684:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969927.303833:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732003200 00000100:00100000:2.0:1788969927.303844:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732003200 00000100:00100000:2.0:1788969927.303895:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 210 00000100:00100000:2.0:1788969927.303904:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:8122:x1875870732003200:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788969927.303921:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969927.303940:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e818 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969927.303981:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e818 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969927.304002:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e818 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969927.304011:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030200, rc 0) 00000100:00100000:2.0:1788969927.304108:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:8122:x1875870732003200:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 166us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969927.304115:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 210 00000100:00100000:1.0:1788969927.307092:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969927.307214:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732003328 00000100:00100000:0.0:1788969927.307224:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732003328 00000100:00100000:0.0:1788969927.307272:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 211 00000100:00100000:0.0:1788969927.307279:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:8122:x1875870732003328:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788969927.307529:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:8122:x1875870732003328:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 250us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969927.307535:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 211 00000100:00100000:1.0:1788969927.309893:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969927.310439:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732003456 00000100:00100000:0.0:1788969927.310449:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732003456 00000100:00100000:0.0:1788969927.310567:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 212 00000100:00100000:0.0:1788969927.310588:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:8122:x1875870732003456:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788969927.310888:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:8122:x1875870732003456:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 312us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969927.310896:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 212 00000100:00100000:1.0:1788969927.314351:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969927.317275:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732003584 00000100:00100000:2.0:1788969927.317292:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732003584 00000100:00100000:2.0:1788969927.317349:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 213 00000100:00100000:2.0:1788969927.317360:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:8130:x1875870732003584:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788969927.318125:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:8130:x1875870732003584:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 764us (3776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969927.318135:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 213 00000100:00100000:1.0:1788969927.323044:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969927.331930:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732003712 00000100:00100000:2.0:1788969927.331948:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732003712 00000100:00100000:2.0:1788969927.332218:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 214 00000100:00100000:2.0:1788969927.332230:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:8130:x1875870732003712:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788969927.332480:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:8130:x1875870732003712:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 251us (9444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969927.332489:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 214 00000100:00100000:1.0:1788969927.353352:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969927.353397:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969927.353502:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732003840 00000100:00100000:3.0:1788969927.353511:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732003840 00000100:00100000:3.0:1788969927.353555:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732004224 00000100:00100000:3.0:1788969927.353558:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732004224 00000100:00100000:3.0:1788969927.353608:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1788969927.353617:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732004224:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969927.353688:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732004224:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 72us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969927.353696:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1788969927.353713:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1788969927.353717:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875870732003840:12345-192.168.202.9@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788969927.353744:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4820ff5c-59fe-4420-a2a6-abcfc7a3612a@192.168.202.9@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1788969927.353778:0:5834:0:(genops.c:1384:class_connect()) connect: client 4820ff5c-59fe-4420-a2a6-abcfc7a3612a, cookie 0x5d0de860b05b3b98 00000004:00100000:3.0:1788969927.353839:0:5834:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1788969927.354122:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97787882b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788969927.354154:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:2352:x1875870732003840:12345-192.168.202.9@tcp:38:mount.lustre.0 Request processed in 435us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969927.354162:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00080000:1.0:1788969927.354402:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969927.358907:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969927.359007:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732004096 00000100:00100000:3.0:1788969927.359017:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732004096 00000100:00100000:3.0:1788969927.359101:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1788969927.359112:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:8122:x1875870732004096:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788969927.359163:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788969927.359257:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:8122:x1875870732004096:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 147us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969927.359264:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00080000:1.0:1788969927.359619:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969927.360562:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969927.360922:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732003968 00000100:00100000:0.0:1788969927.360934:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732003968 00000100:00100000:2.0:1788969927.361090:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:2.0:1788969927.361101:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:0:x1875870732003968:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788969927.361130:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788969927.361201:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:0:x1875870732003968:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 102us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969927.361208:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:0.0:1788969927.365952:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969927.366834:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732004352 00000100:00100000:3.0:1788969927.366847:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732004352 00000100:00100000:0.0:1788969927.366948:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:0.0:1788969927.366958:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:8122:x1875870732004352:12345-192.168.202.9@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788969927.367293:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:8122:x1875870732004352:12345-192.168.202.9@tcp:40:mount.lustre.0 Request processed in 335us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969927.367301:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1788969927.371148:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969927.371298:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732004480 00000100:00100000:3.0:1788969927.371309:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732004480 00000100:00100000:3.0:1788969927.371367:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1788969927.371375:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875870732004480:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788969927.371410:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4820ff5c-59fe-4420-a2a6-abcfc7a3612a@192.168.202.9@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1788969927.371442:0:6676:0:(genops.c:1384:class_connect()) connect: client 4820ff5c-59fe-4420-a2a6-abcfc7a3612a, cookie 0x5d0de860b05b3b9f 00002000:00100000:3.0:1788969927.371453:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4820ff5c-59fe-4420-a2a6-abcfc7a3612a/ffff97787882a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788969927.371464:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788969927.371939:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788969927.371969:0:6676:0:(import.c:65:import_set_state_nolock()) ffff97787882f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788969927.372033:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:2352:x1875870732004480:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 656us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969927.372041:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1788969927.376446:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969927.376494:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969927.376657:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732004736 00000100:00100000:1.0:1788969927.376666:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732004736 00000100:00100000:1.0:1788969927.376734:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:1.0:1788969927.376744:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:8122:x1875870732004736:12345-192.168.202.9@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788969927.376867:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788969927.376954:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:8122:x1875870732004736:12345-192.168.202.9@tcp:33:mount.lustre.0 Request processed in 211us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969927.376963:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:0.0:1788969927.377433:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732004608 00000100:00100000:0.0:1788969927.377448:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732004608 00000100:00100000:0.0:1788969927.377485:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:0.0:1788969927.377491:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875870732004608:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788969927.377514:0:6679:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4820ff5c-59fe-4420-a2a6-abcfc7a3612a@192.168.202.9@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1788969927.377551:0:6679:0:(genops.c:1384:class_connect()) connect: client 4820ff5c-59fe-4420-a2a6-abcfc7a3612a, cookie 0x5d0de860b05b3ba6 00002000:00100000:0.0:1788969927.377562:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4820ff5c-59fe-4420-a2a6-abcfc7a3612a/ffff97784eb32000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788969927.377585:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788969927.378140:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788969927.378170:0:6679:0:(import.c:65:import_set_state_nolock()) ffff97784eb37800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788969927.378267:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:2352:x1875870732004608:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 774us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969927.378275:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000001:00100000:1.0:1788969927.702730:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4820ff5c-59fe-4420-a2a6-abcfc7a3612a 00010000:00010000:1.0:1788969927.750551:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969928.133124:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741471360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788969928.133194:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969928.133569:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741471360 00000100:00100000:3.0:1788969928.133578:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741471360 00000100:00100000:3.0:1788969928.133653:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788969928.133664:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741471360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788969928.133686:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969928.133733:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741471360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969928.133740:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788969928.133873:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788969928.133904:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787857d2c0 x1875870741471360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969928.133922:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741471360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969928.137918:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741471488:0@lo:400:kworker.0 00000100:00100000:2.0:1788969928.137989:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969928.138023:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741472000:0@lo:400:kworker.0 00000100:00100000:2.0:1788969928.138051:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969928.138099:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969928.138105:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741471616:0@lo:400:kworker.0 00000100:00100000:2.0:1788969928.138128:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969928.138159:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741472000 00000100:00100000:2.0:1788969928.138165:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741472000 00000100:00100000:2.0:1788969928.138212:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741471616 00000100:00100000:2.0:1788969928.138215:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741471616 00000100:00100000:2.0:1788969928.138234:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788969928.138242:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741472000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969928.138293:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741472000:12345-0@lo:400:kworker.0 Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969928.138300:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788969928.138315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788969928.138321:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741471616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969928.138347:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741471616:12345-0@lo:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969928.138353:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788969928.138391:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741471616:0@lo:400:kworker.0 00000100:00100000:2.0:1788969928.138402:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741472000:0@lo:400:kworker.0 00000100:00100000:0.0:1788969928.138588:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741471744:0@lo:400:kworker.0 00000100:00100000:0.0:1788969928.138617:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969928.138644:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969928.138650:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741471872:0@lo:400:kworker.0 00000100:00100000:0.0:1788969928.138674:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969928.138703:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741471872 00000100:00100000:0.0:1788969928.138707:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741471872 00000100:00100000:0.0:1788969928.138746:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788969928.138753:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741471872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969928.138816:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741471872:12345-0@lo:400:kworker.0 Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969928.138823:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788969928.138843:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788969928.138861:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880ebf0c0 x1875870741471872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969928.138873:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741471872:0@lo:400:kworker.0 00000100:00100000:2.0:1788969928.138941:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741471744 00000100:00100000:2.0:1788969928.138945:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741471744 00000100:00100000:2.0:1788969928.138984:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788969928.138989:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741471744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969928.139018:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741471744:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969928.139023:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788969928.139441:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741471488 00000100:00100000:3.0:1788969928.139447:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741471488 00000100:00100000:3.0:1788969928.139474:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788969928.139481:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741471488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969928.139524:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741471488:12345-0@lo:400:kworker.0 Request processed in 44us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969928.139529:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788969928.139566:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741471488:0@lo:400:kworker.0 00000100:00080000:0.0:1788969928.139638:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969928.139659:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741471744:0@lo:400:kworker.0 00010000:00010000:3.0:1788969928.776093:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788969929.781543:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4820ff5c-59fe-4420-a2a6-abcfc7a3612a 00010000:00010000:1.0:1788969929.797131:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788969930.244558:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4820ff5c-59fe-4420-a2a6-abcfc7a3612a 00010000:00010000:3.0:1788969930.821024:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969931.847177:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969932.234210:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741472128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788969932.234295:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969932.234445:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741472128 00000100:00100000:1.0:1788969932.234454:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741472128 00000100:00100000:1.0:1788969932.234515:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788969932.234525:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741472128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788969932.234594:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969932.234672:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741472128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969932.234680:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788969932.234828:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778539b8000 x1875870741472128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969932.234849:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741472128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788969932.235110:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788969932.471836:0:10289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788969932.865867:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969932.865921:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969932.865957:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969932.865996:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969932.866037:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969932.866070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732005120 00000100:00100000:1.0:1788969932.866082:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732005376 00000100:00100000:3.0:1788969932.866083:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732005120 00000100:00100000:1.0:1788969932.866090:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732005376 00000100:00100000:1.0:1788969932.866164:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732005248 00000100:00100000:1.0:1788969932.866168:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732005248 00000100:00100000:0.0:1788969932.866176:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732004992 00000100:00100000:0.0:1788969932.866183:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732004992 00000100:00100000:2.0:1788969932.866224:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732004864 00000100:00100000:2.0:1788969932.866231:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732004864 00000100:00100000:2.0:1788969932.866268:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 216 00000100:00100000:2.0:1788969932.866278:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732004864:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969932.866377:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732004864:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 100us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969932.866385:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 216 00000100:00100000:2.0:1788969932.866439:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:2.0:1788969932.866447:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732005376:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969932.866476:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732005376:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 31us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969932.866482:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:1.0:1788969932.871681:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:1.0:1788969932.871698:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732005248:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969932.871868:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732005248:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 174us (5829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969932.871876:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:3.0:1788969932.872269:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:3.0:1788969932.872281:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732005120:12345-192.168.202.9@tcp:400:kworker.0 00000100:00080000:2.0:1788969932.874489:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788969932.874500:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788969932.874504:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788969932.874713:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732005120:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 2430us (8785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969932.874725:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00010000:00010000:3.0:1788969932.874824:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969932.875966:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:0.0:1788969932.875980:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2356:x1875870732004992:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969932.876066:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2356:x1875870732004992:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 89us (10069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969932.876073:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:1.0:1788969933.253142:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788969933.253167:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741472256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788969933.253235:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969933.253353:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741472256 00000100:00100000:3.0:1788969933.253363:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741472256 00000100:00100000:3.0:1788969933.253425:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788969933.253434:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778539ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741472256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788969933.253468:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969933.253515:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778539ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741472256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969933.253534:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788969933.253570:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787857d2c0 x1875870741472256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969933.253588:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741472256:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788969933.255821:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788969933.260128:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741472512:0@lo:400:kworker.0 00000100:00100000:2.0:1788969933.260203:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969933.260261:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969933.260267:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878928b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741472640:0@lo:400:kworker.0 00000100:00100000:2.0:1788969933.260288:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969933.260351:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741472512 00000100:00100000:2.0:1788969933.260359:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741472512 00000100:00100000:2.0:1788969933.260399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741472640 00000100:00100000:2.0:1788969933.260402:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741472640 00000100:00100000:2.0:1788969933.260429:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788969933.260437:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741472512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969933.260490:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741472512:12345-0@lo:400:kworker.0 Request processed in 53us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969933.260497:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788969933.260513:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788969933.260519:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741472640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969933.260545:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741472640:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969933.260551:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788969933.260872:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878928b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741472640:0@lo:400:kworker.0 00000100:00100000:2.0:1788969933.260883:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741472512:0@lo:400:kworker.0 00000100:00080000:2.0:1788969933.260916:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969933.262944:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741472768:0@lo:400:kworker.0 00000100:00100000:0.0:1788969933.263035:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969933.263106:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788969933.263113:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741472384:0@lo:400:kworker.0 00000100:00100000:0.0:1788969933.263159:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969933.263205:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741472896:0@lo:400:kworker.0 00000100:00100000:0.0:1788969933.263229:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969933.263265:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741472896 00000100:00100000:0.0:1788969933.263272:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741472896 00000100:00100000:0.0:1788969933.263319:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788969933.263329:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741472896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969933.263384:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741472896:12345-0@lo:400:kworker.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969933.263390:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788969933.263432:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741472896:0@lo:400:kworker.0 00000100:00100000:1.0:1788969933.263566:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741472384 00000100:00100000:1.0:1788969933.263572:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741472384 00000100:00100000:1.0:1788969933.263612:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788969933.263620:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741472384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969933.263662:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741472384:12345-0@lo:400:kworker.0 Request processed in 43us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969933.263668:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788969933.263703:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741472384:0@lo:400:kworker.0 00000100:00100000:2.0:1788969933.266717:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741472768 00000100:00100000:2.0:1788969933.266734:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741472768 00000100:00100000:2.0:1788969933.266869:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788969933.266879:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741472768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969933.266968:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741472768:12345-0@lo:400:kworker.0 Request processed in 92us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969933.266974:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788969933.266999:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788969933.267772:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778789283c0 x1875870741472768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969933.267814:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741472768:0@lo:400:kworker.0 00010000:00010000:1.0:1788969933.893296:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969934.928355:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969935.945447:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969936.972215:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969937.349066:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788969937.349090:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741473024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969937.349165:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969937.349185:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741473024 00000100:00100000:3.0:1788969937.349194:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741473024 00000100:00100000:3.0:1788969937.349246:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788969937.349256:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741473024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788969937.349292:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969937.349349:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741473024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969937.349356:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788969937.349384:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788969937.349564:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880ebed00 x1875870741473024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969937.349582:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741473024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788969937.985306:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969937.985370:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969937.985402:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969937.985423:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969937.985456:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969937.985488:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732005888 00000100:00100000:1.0:1788969937.985497:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732005888 00000100:00100000:1.0:1788969937.985554:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732006016 00000100:00100000:1.0:1788969937.985558:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732006016 00000100:00100000:1.0:1788969937.985582:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:1.0:1788969937.985608:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732005888:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969937.985676:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732005888:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 85us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969937.985683:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:1.0:1788969937.985701:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:1.0:1788969937.985708:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732006016:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969937.985734:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732006016:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969937.985739:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:1.0:1788969937.985757:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732005504 00000100:00100000:1.0:1788969937.985760:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732005504 00000100:00100000:1.0:1788969937.985783:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 218 00000100:00100000:1.0:1788969937.985807:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732005504:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969937.985835:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732005504:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 45us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969937.985841:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 218 00000100:00100000:3.0:1788969937.985985:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732005632 00000100:00100000:3.0:1788969937.985990:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732005632 00000100:00100000:3.0:1788969937.986026:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732005760 00000100:00100000:3.0:1788969937.986029:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732005760 00000100:00100000:3.0:1788969937.986054:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:3.0:1788969937.986061:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878928780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732005632:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969937.986092:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878928780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732005632:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 32us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969937.986098:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:3.0:1788969937.986111:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:3.0:1788969937.986117:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732005760:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969937.986140:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732005760:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969937.986146:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00080000:3.0:1788969937.986163:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788969937.986168:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788969937.986170:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788969938.000057:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969938.373218:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741473152:0@lo:400:kworker.0 00000100:00100000:2.0:1788969938.373293:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969938.373340:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741473664:0@lo:400:kworker.0 00000100:00100000:2.0:1788969938.373368:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969938.373398:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788969938.373404:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741473536:0@lo:400:kworker.0 00000100:00100000:2.0:1788969938.373428:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969938.373463:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741473664 00000100:00100000:2.0:1788969938.373471:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741473664 00000100:00100000:2.0:1788969938.373520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788969938.373528:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741473664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969938.373578:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741473664:12345-0@lo:400:kworker.0 Request processed in 51us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969938.373586:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788969938.373610:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741473536 00000100:00100000:2.0:1788969938.373613:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741473536 00000100:00100000:2.0:1788969938.373640:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788969938.373646:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741473536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969938.373675:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741473536:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969938.373681:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788969938.373736:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787892b840 x1875870741473536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969938.373751:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741473536:0@lo:400:kworker.0 00000100:00100000:2.0:1788969938.373763:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741473664:0@lo:400:kworker.0 00000100:00100000:1.0:1788969938.373852:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741473152 00000100:00100000:1.0:1788969938.373863:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741473152 00000100:00100000:1.0:1788969938.374186:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788969938.374193:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741473152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969938.374232:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741473152:12345-0@lo:400:kworker.0 Request processed in 40us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969938.374238:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788969938.374321:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741473152:0@lo:400:kworker.0 00000100:00100000:3.0:1788969938.374486:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741473408:0@lo:400:kworker.0 00000100:00100000:3.0:1788969938.374517:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969938.374536:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788969938.374542:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741473280:0@lo:400:kworker.0 00000100:00100000:3.0:1788969938.374562:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969938.374581:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878929a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741473792:0@lo:400:kworker.0 00000100:00100000:3.0:1788969938.374606:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788969938.374629:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969938.374640:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741473408 00000100:00100000:3.0:1788969938.374652:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741473408 00000100:00100000:3.0:1788969938.374693:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741473280 00000100:00100000:3.0:1788969938.374696:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741473280 00000100:00100000:3.0:1788969938.374710:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788969938.374716:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741473408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969938.374753:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741473408:12345-0@lo:400:kworker.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969938.374758:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788969938.374771:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788969938.374777:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741473280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969938.374827:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741473280:12345-0@lo:400:kworker.0 Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969938.374834:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788969938.374858:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741473792 00000100:00100000:3.0:1788969938.374861:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741473792 00000100:00100000:3.0:1788969938.375029:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788969938.375036:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741473792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969938.375069:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741473792:12345-0@lo:400:kworker.0 Request processed in 34us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969938.375074:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788969938.375092:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788969938.375095:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969938.375113:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741473280:0@lo:400:kworker.0 00010000:00080000:3.0:1788969938.375123:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878929a40 x1875870741473792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969938.375132:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878929a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741473792:0@lo:400:kworker.0 00000100:00100000:3.0:1788969938.375155:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741473408:0@lo:400:kworker.0 00000100:00100000:0.0:1788969938.375430:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969938.375440:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741473920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788969938.375487:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969938.375553:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741473920 00000100:00100000:2.0:1788969938.375558:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741473920 00000100:00100000:2.0:1788969938.375592:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788969938.375600:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741473920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788969938.375626:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788969938.375669:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741473920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969938.375675:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788969938.375737:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880ebc000 x1875870741473920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969938.375752:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741473920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788969939.013395:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969940.037068:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969941.062561:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969942.086141:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969942.471521:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741474048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788969942.471853:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969942.471975:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741474048 00000100:00100000:3.0:1788969942.471982:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741474048 00000100:00100000:3.0:1788969942.472049:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788969942.472060:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741474048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788969942.472093:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969942.472131:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741474048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969942.472135:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788969942.472161:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788969942.472177:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787dcb7480 x1875870741474048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969942.472197:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741474048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788969943.098267:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969943.098657:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969943.098692:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969943.098725:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969943.098776:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969943.098856:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732006400 00000100:00100000:1.0:1788969943.098866:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732006400 00000100:00100000:1.0:1788969943.098937:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732006272 00000100:00100000:1.0:1788969943.098940:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732006272 00000100:00100000:1.0:1788969943.098967:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:1.0:1788969943.098977:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878929680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2355:x1875870732006400:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969943.099048:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878929680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2355:x1875870732006400:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 73us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969943.099054:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:1.0:1788969943.099071:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:1.0:1788969943.099077:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732006272:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969943.099112:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732006272:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 35us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969943.099118:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00080000:1.0:1788969943.099134:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969943.099313:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732006656 00000100:00100000:0.0:1788969943.099319:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732006656 00000100:00100000:0.0:1788969943.099361:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732006528 00000100:00100000:0.0:1788969943.099364:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732006528 00000100:00100000:0.0:1788969943.099397:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:0.0:1788969943.099405:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878928f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2355:x1875870732006656:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969943.099438:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878928f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2355:x1875870732006656:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 35us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969943.099445:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:0.0:1788969943.099457:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:0.0:1788969943.099463:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878929a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2355:x1875870732006528:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969943.099484:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878929a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2355:x1875870732006528:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 22us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969943.099490:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00080000:1.0:1788969943.099996:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788969943.100000:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788969943.103138:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732006144 00000100:00100000:2.0:1788969943.103153:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732006144 00000100:00100000:2.0:1788969943.103224:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 220 00000100:00100000:2.0:1788969943.103235:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2355:x1875870732006144:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969943.103551:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2355:x1875870732006144:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 316us (5293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969943.103560:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 220 00010000:00010000:0.0:1788969943.113363:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969943.493013:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741474176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788969943.493078:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969943.494339:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741474304:0@lo:400:kworker.0 00000100:00100000:0.0:1788969943.494390:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969943.494436:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741474816:0@lo:400:kworker.0 00000100:00100000:0.0:1788969943.494464:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969943.494488:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969943.494503:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741474432:0@lo:400:kworker.0 00000100:00100000:0.0:1788969943.494526:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969943.494559:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741474304 00000100:00100000:0.0:1788969943.494568:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741474304 00000100:00100000:0.0:1788969943.494612:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788969943.494621:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741474304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969943.495092:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741474304:12345-0@lo:400:kworker.0 Request processed in 471us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969943.495100:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788969943.495147:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741474816 00000100:00100000:0.0:1788969943.495152:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741474816 00000100:00100000:0.0:1788969943.495185:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741474432 00000100:00100000:0.0:1788969943.495189:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741474432 00000100:00100000:0.0:1788969943.495206:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788969943.495212:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741474816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969943.495244:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741474816:12345-0@lo:400:kworker.0 Request processed in 33us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969943.495251:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788969943.495262:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788969943.495268:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741474432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969943.495294:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741474432:12345-0@lo:400:kworker.0 Request processed in 27us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969943.495300:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788969943.495320:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969943.495340:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741474688:0@lo:400:kworker.0 00000100:00100000:0.0:1788969943.495364:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969943.495384:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788969943.495390:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741474560:0@lo:400:kworker.0 00000100:00100000:0.0:1788969943.495409:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969943.495431:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741474688 00000100:00100000:0.0:1788969943.495434:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741474688 00000100:00100000:0.0:1788969943.495458:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788969943.495465:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741474688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969943.495781:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741474176 00000100:00100000:2.0:1788969943.495786:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741474176 00000100:00100000:2.0:1788969943.495842:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788969943.495850:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741474176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788969943.495877:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788969943.497151:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741474176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (2844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969943.497171:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788969943.497249:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741474560 00000100:00100000:2.0:1788969943.497256:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741474560 00000100:00100000:2.0:1788969943.497298:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788969943.497306:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741474560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969943.497365:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741474560:12345-0@lo:400:kworker.0 Request processed in 60us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969943.497372:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788969943.497412:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741474432:0@lo:400:kworker.0 00000100:00100000:0.0:1788969943.498606:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741474688:12345-0@lo:400:kworker.0 Request processed in 3136us (3235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969943.498618:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788969943.500124:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788969943.500134:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788969943.500185:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741474560:0@lo:400:kworker.0 00010000:00080000:0.0:1788969943.500202:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787dcb6580 x1875870741474688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969943.500212:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741474688:0@lo:400:kworker.0 00010000:00080000:0.0:1788969943.500226:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787892a1c0 x1875870741474176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969943.500243:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741474176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969943.500963:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741474304:0@lo:400:kworker.0 00000100:00100000:2.0:1788969943.500987:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741474816:0@lo:400:kworker.0 00010000:00010000:1.0:1788969944.133984:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969945.157992:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969946.187529:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969947.207352:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969947.600215:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741474944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788969947.600282:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969947.600421:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741474944 00000100:00100000:3.0:1788969947.600429:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741474944 00000100:00100000:3.0:1788969947.600502:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788969947.600511:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741474944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788969947.600544:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969947.607039:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741474944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6518us (6747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969947.607057:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788969947.607099:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788969947.610113:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778789b43c0 x1875870741474944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969947.610144:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741474944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788969948.219939:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969948.219982:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969948.220007:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969948.220089:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969948.220122:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732006784 00000100:00100000:1.0:1788969948.220131:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732006784 00000100:00100000:1.0:1788969948.220179:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 222 00000100:00100000:1.0:1788969948.220190:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732006784:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969948.220255:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732006784:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969948.220270:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 222 00000100:00100000:3.0:1788969948.220359:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732007168 00000100:00100000:3.0:1788969948.220384:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732007168 00000100:00100000:3.0:1788969948.220434:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:3.0:1788969948.220453:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878929e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2352:x1875870732007168:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:3.0:1788969948.220473:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3b9f 00000100:00080000:3.0:1788969948.220483:0:6679:0:(import.c:65:import_set_state_nolock()) ffff97787882f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788969948.220522:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788969948.220857:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878929e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+2:2352:x1875870732007168:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 415us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969948.220865:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00010000:00010000:3.0:1788969948.220899:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788969948.221323:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788969948.222389:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732007040 00000100:00100000:1.0:1788969948.222398:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732007040 00000100:00100000:1.0:1788969948.222477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732006912 00000100:00100000:1.0:1788969948.222480:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732006912 00000100:00100000:1.0:1788969948.222507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:1.0:1788969948.222516:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732007040:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969948.222588:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732007040:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 73us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969948.222595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:1.0:1788969948.222611:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:1.0:1788969948.222617:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732006912:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969948.222640:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732006912:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 24us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969948.222646:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00080000:3.0:1788969948.222762:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969948.232899:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969948.233035:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732007296 00000100:00100000:2.0:1788969948.233045:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732007296 00000100:00100000:2.0:1788969948.233104:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788969948.233113:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2352:x1875870732007296:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:2.0:1788969948.233142:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3ba6 00000100:00080000:2.0:1788969948.233150:0:6676:0:(import.c:65:import_set_state_nolock()) ffff97784eb37800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788969948.233184:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788969948.233575:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+2:2352:x1875870732007296:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 463us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969948.233581:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00010000:00010000:2.0:1788969948.233598:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969948.235529:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788969948.235870:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788969948.617014:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788969948.617037:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878928b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741475072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788969948.617108:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969948.617335:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741475072 00000100:00100000:1.0:1788969948.617344:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741475072 00000100:00100000:1.0:1788969948.617421:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788969948.617433:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741475072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788969948.617469:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969948.617516:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741475072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969948.617522:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788969948.617668:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977878928b40 x1875870741475072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969948.617688:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878928b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741475072:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788969948.617769:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788969948.618099:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741475200:0@lo:400:kworker.0 00000100:00100000:0.0:1788969948.618150:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969948.618213:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741475200 00000100:00100000:1.0:1788969948.618219:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741475200 00000100:00100000:1.0:1788969948.618257:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788969948.618265:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741475200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969948.618347:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741475328:0@lo:400:kworker.0 00000100:00100000:2.0:1788969948.618400:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969948.618444:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788969948.618450:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741475456:0@lo:400:kworker.0 00000100:00100000:2.0:1788969948.618472:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969948.619744:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741475200:12345-0@lo:400:kworker.0 Request processed in 1473us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969948.619756:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788969948.622842:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741475328 00000100:00100000:1.0:1788969948.622852:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741475328 00000100:00100000:1.0:1788969948.622916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741475456 00000100:00100000:1.0:1788969948.622920:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741475456 00000100:00100000:1.0:1788969948.622970:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788969948.622979:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741475328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969948.623070:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741475328:12345-0@lo:400:kworker.0 Request processed in 92us (4668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969948.623077:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788969948.623088:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788969948.623095:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741475456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969948.623123:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741475456:12345-0@lo:400:kworker.0 Request processed in 29us (4650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969948.623128:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788969948.623174:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741475456:0@lo:400:kworker.0 00000100:00100000:1.0:1788969948.623185:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741475328:0@lo:400:kworker.0 00000100:00080000:1.0:1788969948.623209:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969948.629500:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741475200:0@lo:400:kworker.0 00000100:00100000:0.0:1788969948.629532:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788969948.629576:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741475584:0@lo:400:kworker.0 00000100:00100000:0.0:1788969948.629637:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969948.629725:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741475584 00000100:00100000:3.0:1788969948.629732:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741475584 00000100:00100000:3.0:1788969948.629824:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788969948.629834:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741475584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969948.629899:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741475584:12345-0@lo:400:kworker.0 Request processed in 66us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969948.629906:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788969948.630118:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880ebe1c0 x1875870741475584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969948.630131:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741475584:0@lo:400:kworker.0 00000100:00100000:3.0:1788969948.632039:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969948.636365:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741475712:0@lo:400:kworker.0 00000100:00100000:2.0:1788969948.636455:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969948.636608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741475712 00000100:00100000:1.0:1788969948.636617:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741475712 00000100:00100000:1.0:1788969948.636697:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788969948.636706:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741475712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969948.636807:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741475712:12345-0@lo:400:kworker.0 Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969948.636815:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788969948.636925:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741475712:0@lo:400:kworker.0 00000100:00080000:3.0:1788969948.637197:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788969949.271327:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788969949.933923:0:10990:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788969950.212767:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4820ff5c-59fe-4420-a2a6-abcfc7a3612a 00000020:00000080:0.0:1788969950.212777:0:7615:0:(genops.c:885:class_export_put()) final put ffff97784eb32000/4820ff5c-59fe-4420-a2a6-abcfc7a3612a 00000020:00000080:1.0:1788969950.212925:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97784eb32000/4820ff5c-59fe-4420-a2a6-abcfc7a3612a for lustre-OST0001 00000020:00000080:1.0:1788969950.212981:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97784eb37800 for lustre-OST0001 00010000:00010000:0.0:1788969950.277102:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969951.301964:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969952.331357:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969952.713146:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788969952.713169:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741475840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788969952.713704:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969952.713826:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741475840 00000100:00100000:1.0:1788969952.713845:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741475840 00000100:00100000:1.0:1788969952.713913:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788969952.713925:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741475840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788969952.713962:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969952.714020:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741475840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969952.714026:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788969952.714076:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778789b43c0 x1875870741475840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969952.714095:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741475840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788969952.715362:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788969953.283037:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4820ff5c-59fe-4420-a2a6-abcfc7a3612a 00000020:00000080:0.0:1788969953.283049:0:6702:0:(genops.c:885:class_export_put()) final put ffff97787882a800/4820ff5c-59fe-4420-a2a6-abcfc7a3612a 00000020:00000080:2.0:1788969953.283138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787882a800/4820ff5c-59fe-4420-a2a6-abcfc7a3612a for lustre-OST0000 00000020:00000080:2.0:1788969953.283266:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787882f000 for lustre-OST0000 00000100:00100000:0.0:1788969953.336945:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969953.337004:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969953.337065:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969953.337113:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732007552 00000100:00100000:3.0:1788969953.337124:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732007552 00000100:00100000:3.0:1788969953.337185:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732007680 00000100:00100000:3.0:1788969953.337197:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732007680 00000100:00100000:3.0:1788969953.337220:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:3.0:1788969953.337228:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732007552:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969953.337299:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732007552:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969953.337307:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:3.0:1788969953.337322:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:3.0:1788969953.337328:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732007680:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969953.337349:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732007680:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 21us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969953.337355:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00080000:0.0:1788969953.338286:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969953.338373:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732007424 00000100:00100000:2.0:1788969953.338382:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732007424 00000100:00100000:2.0:1788969953.338440:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 224 00000100:00100000:2.0:1788969953.338448:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732007424:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969953.338506:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732007424:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 59us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969953.338513:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 224 00010000:00010000:1.0:1788969953.349076:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969953.732913:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741475968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788969953.732982:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969953.733049:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741475968 00000100:00100000:1.0:1788969953.733057:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741475968 00000100:00100000:1.0:1788969953.733105:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788969953.733113:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741475968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788969953.733147:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969953.733187:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741475968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969953.733194:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788969953.733231:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787892b840 x1875870741475968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969953.733248:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741475968:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788969953.733286:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788969953.733993:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878928b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741476352:0@lo:400:kworker.0 00000100:00100000:1.0:1788969953.734048:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969953.734081:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788969953.734087:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741476480:0@lo:400:kworker.0 00000100:00100000:1.0:1788969953.734114:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969953.734194:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741476096:0@lo:400:kworker.0 00000100:00100000:3.0:1788969953.734228:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969953.734259:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741476608:0@lo:400:kworker.0 00000100:00100000:3.0:1788969953.734280:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969953.734299:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788969953.734305:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741476224:0@lo:400:kworker.0 00000100:00100000:3.0:1788969953.734324:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969953.734350:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741476352 00000100:00100000:3.0:1788969953.734355:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741476352 00000100:00100000:3.0:1788969953.734403:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741476608 00000100:00100000:3.0:1788969953.734406:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741476608 00000100:00100000:3.0:1788969953.734422:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741476224 00000100:00100000:3.0:1788969953.734424:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741476224 00000100:00100000:3.0:1788969953.734436:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788969953.734443:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741476352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969953.734501:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741476352:12345-0@lo:400:kworker.0 Request processed in 58us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969953.734508:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788969953.734524:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788969953.734530:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741476608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969953.734570:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741476608:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969953.734576:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788969953.734590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788969953.734596:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741476224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969953.734621:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741476224:12345-0@lo:400:kworker.0 Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969953.734626:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788969953.734661:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741476224:0@lo:400:kworker.0 00000100:00100000:3.0:1788969953.734672:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741476608:0@lo:400:kworker.0 00000100:00100000:3.0:1788969953.734697:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878928b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741476352:0@lo:400:kworker.0 00000100:00080000:3.0:1788969953.734719:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969953.734959:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741476480 00000100:00100000:3.0:1788969953.734964:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741476480 00000100:00100000:3.0:1788969953.734993:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788969953.735000:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741476480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969953.735037:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741476480:12345-0@lo:400:kworker.0 Request processed in 38us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969953.735044:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788969953.735079:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778789b43c0 x1875870741476480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969953.735090:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741476480:0@lo:400:kworker.0 00000100:00100000:1.0:1788969953.735162:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741476096 00000100:00100000:1.0:1788969953.735166:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741476096 00000100:00100000:1.0:1788969953.735203:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788969953.735209:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741476096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969953.735242:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741476096:12345-0@lo:400:kworker.0 Request processed in 33us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969953.735248:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788969953.735324:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741476096:0@lo:400:kworker.0 00000020:00000080:3.0:1788969954.052218:0:11140:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd86295810 20000000:00000080:3.0:1788969954.052236:0:11140:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff977880f8f800 uarg=0000000000000000 20000000:01000000:3.0:1788969954.052274:0:11140:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788969954.052280:0:11140:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788969954.052285:0:11140:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788969954.059052:0:11141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788969954.059226:0:11140:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788969954.062649:0:11140:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788969954.062753:0:11140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.062775:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e0 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.062783:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b59 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.062836:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b67 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.062843:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3b75 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.062849:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e818 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.062873:0:11140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.062914:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e818 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.062928:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e818 expref: 12 pid: 5826 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969954.062942:0:11140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa14b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741476736:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788969954.063039:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3b75 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.063047:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3b75 expref: 18 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969954.063054:0:11140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa143c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741476864:0@lo:104: 00000100:00100000:1.0:1788969954.063093:0:11140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788969954.063139:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3b67 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.063147:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3b67 expref: 18 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969954.063154:0:11140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa16d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741476992:0@lo:104: 00000100:00100000:1.0:1788969954.063175:0:11140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788969954.063201:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3b59 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.063219:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3b59 expref: 18 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969954.063227:0:11140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa14780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741477120:0@lo:104: 00000100:00100000:1.0:1788969954.063248:0:11140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788969954.063266:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e0 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.063273:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e0 expref: 12 pid: 5827 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969954.063281:0:11140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741477248:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788969954.063319:0:11140:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786502bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788969954.063622:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741476864 00000100:00100000:0.0:1788969954.063631:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741476864 00000100:00100000:0.0:1788969954.063670:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741476992 00000100:00100000:0.0:1788969954.063673:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741476992 00000100:00100000:0.0:1788969954.063683:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741477120 00000100:00100000:0.0:1788969954.063685:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741477120 00000100:00100000:0.0:1788969954.063697:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788969954.063871:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788969954.063881:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:11140:x1875870741476992:12345-0@lo:104: 00010000:00010000:3.0:1788969954.063893:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.063951:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788969954.063956:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:11140:x1875870741476992:12345-0@lo:104: Request processed in 78us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969954.063963:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788969954.063981:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788969954.063987:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:11140:x1875870741477120:12345-0@lo:104: 00010000:00010000:3.0:1788969954.063995:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064027:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788969954.064033:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:11140:x1875870741477120:12345-0@lo:104: Request processed in 47us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969954.064049:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788969954.064067:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788969954.064073:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064080:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545200 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788969954.064084:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064093:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788969954.064101:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969954.064107:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788969954.064136:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064142:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788969954.064160:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064167:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545200/0x5d0de860b05b3b67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3b6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064181:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788969954.064184:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064202:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5a00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788969954.064204:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064210:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788969954.064216:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969954.064221:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788969954.064234:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064239:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788969954.064254:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064261:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b3b59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.064270:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969954.064272:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969954.064273:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969954.064279:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969954.064286:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788969954.064546:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:11140:x1875870741476864:12345-0@lo:104: 00010000:00010000:0.0:1788969954.064563:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969954.064611:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788969954.064618:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:11140:x1875870741476864:12345-0@lo:104: Request processed in 913us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969954.064624:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788969954.064653:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788969954.064657:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969954.064663:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788969954.064667:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969954.064674:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788969954.064680:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969954.064685:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788969954.064704:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969954.064709:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788969954.064716:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969954.064722:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545400/0x5d0de860b05b3b75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3b7c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969954.064744:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969954.064746:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969954.064748:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969954.065771:0:11140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa143c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741476864:0@lo:104: 00000100:00100000:1.0:1788969954.065784:0:11140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa16d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741476992:0@lo:104: 00000100:00100000:1.0:1788969954.065837:0:11140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa14780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741477120:0@lo:104: 00000100:00100000:3.0:1788969954.066126:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741477376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788969954.066187:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969954.066236:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741477504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788969954.066275:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969954.066307:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788969954.066313:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741477632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788969954.066347:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969954.066381:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741477376 00000100:00100000:3.0:1788969954.066399:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741477376 00010000:00010000:3.0:1788969954.066429:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3b67 expref: 19 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969954.066450:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741477504 00000100:00100000:3.0:1788969954.066453:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741477504 00010000:00010000:3.0:1788969954.066464:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3b59 expref: 20 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969954.066474:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741477632 00000100:00100000:3.0:1788969954.066476:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741477632 00010000:00010000:3.0:1788969954.066484:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3b75 expref: 21 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969954.066496:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788969954.066502:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778600e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+21:3283:x1875870741477376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788969954.066514:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969954.066519:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3b67 expref: 21 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.066529:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3b67 expref: 21 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.066546:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a8e00/0x5d0de860b05b3b6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3b67 expref: 21 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.066572:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788969954.066608:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778600e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+20:3283:x1875870741477376:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969954.066615:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788969954.066656:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788969954.066662:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741477504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788969954.066669:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969954.066673:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3b59 expref: 19 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.066682:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3b59 expref: 19 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.066692:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841544a00/0x5d0de860b05b3b60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3b59 expref: 19 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.066700:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788969954.066723:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3285:x1875870741477504:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969954.066730:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788969954.066742:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788969954.066747:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:3285:x1875870741477632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788969954.066754:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969954.066758:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3b75 expref: 17 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.066766:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3b75 expref: 17 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.066782:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b3b7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3b75 expref: 17 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.066836:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788969954.066861:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:3285:x1875870741477632:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969954.066867:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788969954.066898:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741477632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788969954.066906:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741477504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788969954.066931:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741477376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788969954.070475:0:11140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa14b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741476736:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788969954.071682:0:11140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1875870741477248:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788969954.071722:0:11140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969954.075086:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969954.075130:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969954.075229:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732007808 00000100:00100000:1.0:1788969954.075238:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732007808 00010000:00010000:1.0:1788969954.075279:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e818 expref: 13 pid: 5826 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969954.075340:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732007936 00000100:00100000:1.0:1788969954.075343:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732007936 00010000:00010000:1.0:1788969954.075355:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e0 expref: 14 pid: 5827 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969954.075369:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:1.0:1788969954.075403:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+14:2354:x1875870732007808:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788969954.075418:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969954.075424:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e818 expref: 14 pid: 5826 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075436:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e818 expref: 14 pid: 5826 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075454:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840030200/0x5d0de860b05b3b91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e818 expref: 14 pid: 5826 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075469:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788969954.075503:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788969954.075512:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788969954.075529:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732007808:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 138us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969954.075536:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:1.0:1788969954.075553:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:1.0:1788969954.075560:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:2354:x1875870732007936:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788969954.075567:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969954.075572:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e0 expref: 12 pid: 5827 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075580:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e0 expref: 12 pid: 5827 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075589:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3b52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e0 expref: 12 pid: 5827 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075605:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075620:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075634:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075642:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075650:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075658:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075664:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788969954.075668:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075675:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075696:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969954.075707:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969954.075726:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:2354:x1875870732007936:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 166us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969954.075732:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00010000:00010000:2.0:1788969954.076098:0:11140:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969954.076107:0:11140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969954.076113:0:11140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f92000/0x5d0de860b05b3bad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969954.383333:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969955.193321:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969955.193516:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732008064 00000100:00100000:0.0:1788969955.193526:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732008064 00000100:00100000:0.0:1788969955.193578:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 226 00000100:00100000:0.0:1788969955.193587:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:5598:x1875870732008064:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969955.193605:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969955.193628:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e842 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969955.193655:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e842 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969955.193668:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e842 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969955.193677:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4c00, rc 0) 00000100:00100000:0.0:1788969955.193737:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732008064:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 151us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969955.193744:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 226 00000100:00100000:0.0:1788969955.197095:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969955.197341:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732008192 00000100:00100000:3.0:1788969955.197351:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732008192 00000100:00100000:3.0:1788969955.197405:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 227 00000100:00100000:3.0:1788969955.197415:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732008192:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969955.197898:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732008192:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 482us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969955.197907:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 227 00000100:00100000:0.0:1788969955.200656:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969955.203226:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732008320 00000100:00100000:1.0:1788969955.203250:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732008320 00000100:00100000:1.0:1788969955.203325:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 228 00000100:00100000:1.0:1788969955.203337:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732008320:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969955.203584:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732008320:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 249us (2936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969955.203592:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 228 00000100:00100000:1.0:1788969955.243944:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969955.244416:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732008448 00000100:00100000:3.0:1788969955.244426:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732008448 00000100:00100000:3.0:1788969955.244494:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 229 00000100:00100000:3.0:1788969955.244505:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732008448:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969955.244522:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969955.244555:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e849 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.244589:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e849 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.244601:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e849 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.244612:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841544a00, rc 0) 00000100:00100000:3.0:1788969955.244676:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732008448:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 173us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969955.244684:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 229 00000100:00100000:3.0:1788969955.247026:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969955.247070:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732008576 00000100:00100000:1.0:1788969955.247081:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732008576 00000100:00100000:1.0:1788969955.247145:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 230 00000100:00100000:1.0:1788969955.247155:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732008576:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969955.247625:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732008576:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 469us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969955.247633:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 230 00000100:00100000:1.0:1788969955.252757:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969955.252833:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732008704 00000100:00100000:1.0:1788969955.252843:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732008704 00000100:00100000:1.0:1788969955.252896:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 231 00000100:00100000:1.0:1788969955.252907:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732008704:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969955.253201:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732008704:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 294us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969955.253209:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 231 00010000:00010000:2.0:1788969955.398331:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788969955.972871:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788969955.972879:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97784c0a0000 from 7 10000000:01000000:0.0:1788969955.972891:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788969955.972936:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969955.972952:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969955.972964:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969955.972988:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741477760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788969955.973048:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969955.973101:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11300 going to sleep for 11 seconds 00000100:00100000:3.0:1788969955.973249:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741477760 00000100:00100000:3.0:1788969955.973257:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741477760 00000100:00100000:3.0:1788969955.973311:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788969955.973322:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741477760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969955.973335:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969955.973346:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3bc2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.973370:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3bc2 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.973381:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3bc2 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.973390:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841545200, rc 0) 00000100:00100000:3.0:1788969955.973436:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741477760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969955.973443:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788969955.973535:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741477760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969955.973548:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969955.973557:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969955.973610:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741477888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969955.973637:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969955.973660:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11300 going to sleep for 11 seconds 00000100:00100000:3.0:1788969955.973839:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741477888 00000100:00100000:3.0:1788969955.973844:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741477888 00000100:00100000:3.0:1788969955.973909:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788969955.973916:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741477888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969955.974153:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741477888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969955.974160:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788969955.974225:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741477888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969955.974254:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969955.974291:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969955.980488:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11300 going to sleep for 11 seconds 00000100:00100000:2.0:1788969955.985993:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741478016 00000100:00100000:2.0:1788969955.986009:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741478016 00000100:00100000:2.0:1788969955.986065:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788969955.986075:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741478016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788969955.986471:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741478016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 397us (12178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969955.986479:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788969955.988149:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788969955.989497:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788969955.995483:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788969955.995520:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788969955.995532:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969955.995545:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788969955.995555:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788969955.995558:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9778601fa800 from 7 10000000:01000000:0.0:1788969955.995561:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788969955.995597:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969955.995606:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969955.995616:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969955.995644:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788969955.995710:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969955.995760:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11300 going to sleep for 11 seconds 00000100:00100000:3.0:1788969955.997981:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741478144 00000100:00100000:3.0:1788969955.997994:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741478144 00000100:00100000:3.0:1788969955.998059:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788969955.998069:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741478144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969955.998086:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969955.998103:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3bd0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.998127:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3bd0 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.998138:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3bd0 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.998147:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841544600, rc 0) 00000100:00100000:3.0:1788969955.998215:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741478144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969955.998221:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788969955.998286:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969955.998303:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969955.998312:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969955.998377:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969955.998406:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969955.998435:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1788969955.998448:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741478272 00000100:00100000:3.0:1788969955.998452:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741478272 00000100:00100000:3.0:1788969955.998479:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788969955.998485:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741478272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969955.998711:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741478272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969955.998718:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788969955.998745:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969955.998773:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969955.999293:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969955.999315:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847233780 going to sleep for 11 seconds 00000100:00100000:3.0:1788969955.999328:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741478400 00000100:00100000:3.0:1788969955.999332:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741478400 00000100:00100000:3.0:1788969955.999350:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788969955.999356:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741478400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969955.999497:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741478400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969955.999510:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788969955.999545:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788969956.004768:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788969956.005077:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788969956.005099:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788969956.005111:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969956.005123:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969956.005134:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788969956.005136:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97786f03a800 from 7 10000000:01000000:3.0:1788969956.005138:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788969956.005174:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969956.005182:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969956.005192:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969956.005218:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788969956.005279:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969956.005330:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847233780 going to sleep for 11 seconds 00000100:00100000:2.0:1788969956.005542:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741478528 00000100:00100000:2.0:1788969956.005550:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741478528 00000100:00100000:2.0:1788969956.005596:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788969956.005607:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741478528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788969956.005620:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969956.005633:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3bde expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969956.005655:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3bde expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969956.005685:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3bde expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969956.005695:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030e00, rc 0) 00000100:00100000:2.0:1788969956.009221:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741478528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3606us (3931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969956.009234:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788969956.011441:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969956.011472:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969956.011484:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969956.011581:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969956.011640:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969956.012279:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788969956.018390:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741478656 00000100:00100000:2.0:1788969956.018407:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741478656 00000100:00100000:2.0:1788969956.018584:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788969956.018596:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741478656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788969956.024036:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741478656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5436us (12387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969956.024052:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788969956.024187:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969956.024241:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969956.024303:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969956.033090:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786502b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969956.035224:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741478784 00000100:00100000:3.0:1788969956.035241:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741478784 00000100:00100000:3.0:1788969956.035310:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788969956.035321:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741478784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969956.035599:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741478784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (11294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969956.035607:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788969956.037012:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741478784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788969956.065678:0:11214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788969956.067389:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788969956.067420:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788969956.067436:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969956.067449:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969956.420991:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969957.445258:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969957.829040:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788969957.829060:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741478912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788969957.829279:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969957.829330:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741478912 00000100:00100000:0.0:1788969957.829339:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741478912 00000100:00100000:0.0:1788969957.829400:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788969957.829408:0:6681:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788969957.829413:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741478912:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788969957.829419:0:6681:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788969957.829452:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788969957.829509:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741478912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969957.829517:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788969957.829586:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787f3d9680 x1875870741478912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969957.829605:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741478912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788969957.834625:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788969958.474610:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969958.475544:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969958.475576:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969958.475600:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969958.488015:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732008832 00000100:00100000:1.0:1788969958.488031:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732008832 00000100:00100000:1.0:1788969958.488097:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 241 00000100:00100000:1.0:1788969958.488107:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732008832:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969958.488184:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732008832:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 79us (12646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969958.488192:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 241 00000100:00100000:1.0:1788969958.488228:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732009088 00000100:00100000:1.0:1788969958.488232:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732009088 00000100:00100000:1.0:1788969958.488269:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732008960 00000100:00100000:1.0:1788969958.488274:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732008960 00000100:00100000:1.0:1788969958.488295:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:1.0:1788969958.488302:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732009088:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969958.488341:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732009088:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 40us (12765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969958.488347:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:1.0:1788969958.488358:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:1.0:1788969958.488364:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732008960:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969958.488385:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732008960:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 21us (12784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969958.488390:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00080000:1.0:1788969958.488527:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969958.852987:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741479424:0@lo:400:kworker.0 00000100:00100000:1.0:1788969958.853054:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969958.853106:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788969958.853113:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741479040:0@lo:400:kworker.0 00000100:00100000:1.0:1788969958.853139:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969958.853163:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741479552:0@lo:400:kworker.0 00000100:00100000:1.0:1788969958.853189:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969958.853217:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741479040 00000100:00100000:1.0:1788969958.853225:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741479040 00000100:00100000:1.0:1788969958.853261:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788969958.853268:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741479040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969958.853309:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741479040:12345-0@lo:400:kworker.0 Request processed in 42us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969958.853315:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788969958.853341:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741479552 00000100:00100000:1.0:1788969958.853344:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741479552 00000100:00100000:1.0:1788969958.853381:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788969958.853387:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741479552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969958.853415:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741479552:12345-0@lo:400:kworker.0 Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969958.853420:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788969958.853437:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969958.853476:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741479040:0@lo:400:kworker.0 00000100:00100000:1.0:1788969958.853488:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741479552:0@lo:400:kworker.0 00000100:00100000:3.0:1788969958.853695:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741479168:0@lo:400:kworker.0 00000100:00100000:3.0:1788969958.853724:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969958.853740:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741479680:0@lo:400:kworker.0 00000100:00100000:3.0:1788969958.853758:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969958.853809:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788969958.853816:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741479296:0@lo:400:kworker.0 00000100:00100000:3.0:1788969958.853836:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969958.853854:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741479808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788969958.853872:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969958.853898:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741479424 00000100:00100000:3.0:1788969958.853901:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741479424 00000100:00100000:3.0:1788969958.853926:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741479680 00000100:00100000:3.0:1788969958.853929:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741479680 00000100:00100000:3.0:1788969958.853954:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788969958.853968:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741479424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969958.854002:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741479424:12345-0@lo:400:kworker.0 Request processed in 36us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969958.854008:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788969958.854021:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788969958.854026:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741479680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969958.854054:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741479680:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969958.854059:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788969958.854079:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741479168 00000100:00100000:3.0:1788969958.854082:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741479168 00000100:00100000:3.0:1788969958.854103:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741479296 00000100:00100000:3.0:1788969958.854106:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741479296 00000100:00100000:3.0:1788969958.854123:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788969958.854128:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741479168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969958.854156:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741479168:12345-0@lo:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969958.854161:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788969958.854171:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788969958.854176:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741479296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969958.854201:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741479296:12345-0@lo:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969958.854206:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788969958.854222:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741479808 00000100:00100000:3.0:1788969958.854226:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741479808 00000100:00100000:3.0:1788969958.854247:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788969958.854252:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741479808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788969958.854283:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969958.854311:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741479808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969958.854318:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788969958.854342:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788969958.854346:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788969958.854365:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741479296:0@lo:400:kworker.0 00010000:00080000:3.0:1788969958.854376:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787f3d9680 x1875870741479808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969958.854390:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741479808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788969958.854400:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741479168:0@lo:400:kworker.0 00010000:00080000:3.0:1788969958.854408:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787fa14b40 x1875870741479680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969958.854416:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741479680:0@lo:400:kworker.0 00010000:00080000:3.0:1788969958.854457:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787fa15a40 x1875870741479424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969958.854467:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741479424:0@lo:400:kworker.0 00000001:02000400:1.0:1788969958.941945:0:11341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788969959.497325:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969960.517087:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969961.542234:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969962.572542:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969962.949562:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741479936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788969962.949631:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969962.949779:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741479936 00000100:00100000:0.0:1788969962.949807:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741479936 00000100:00100000:0.0:1788969962.949866:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788969962.949876:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741479936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788969962.949911:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788969962.950002:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788969962.961328:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741479936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11436us (11679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969962.961343:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788969962.969228:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787f3d9680 x1875870741479936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969962.969265:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741479936:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788969963.177203:0:11440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:06:02 (1788969962) === 00000100:00100000:3.0:1788969963.480255:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969963.480394:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969963.480429:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732009216 00000100:00100000:3.0:1788969963.480439:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732009216 00000100:00100000:3.0:1788969963.480821:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:3.0:1788969963.480843:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732009216:12345-192.168.202.9@tcp:41:mkdir.0 00000004:00000024:3.0:1788969963.480900:0:7061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788969963.480999:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732009216:12345-192.168.202.9@tcp:41:mkdir.0 Request processed in 169us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969963.481006:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:3.0:1788969963.481035:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732009344 00000100:00100000:3.0:1788969963.481039:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732009344 00000100:00100000:3.0:1788969963.481062:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1788969963.481069:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:9675:x1875870732009344:12345-192.168.202.9@tcp:700:mkdir.0 00000100:00100000:3.0:1788969963.481101:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:9675:x1875870732009344:12345-192.168.202.9@tcp:700:mkdir.0 Request processed in 33us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969963.481107:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00080000:3.0:1788969963.481123:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969963.486940:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969963.487276:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732009600 00000100:00100000:3.0:1788969963.487286:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732009600 00000100:00100000:3.0:1788969963.487363:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:3.0:1788969963.487373:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:9675:x1875870732009600:12345-192.168.202.9@tcp:36:mkdir.0 00010000:00010000:3.0:1788969963.487428:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969963.487455:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3acd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7cb expref: 6 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.487494:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:3.0:1788969963.487506:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788969963.487838:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.487852:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.487873:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.487887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.487895:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.487902:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969963.488997:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788969963.489011:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.489020:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.489027:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.489033:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.489037:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.489045:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.489056:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3cd00) 00010000:00010000:3.0:1788969963.489059:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969963.489071:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.489078:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3bec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788969963.489098:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6c2b6b9 reply state 00000000e19720d6 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969963.489105:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788969963.489204:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:9675:x1875870732009600:12345-192.168.202.9@tcp:36:mkdir.0 Request processed in 1829us (2272us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788969963.489212:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00010000:00010000:0.0:1788969963.492860:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.492879:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.492888:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.492895:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969963.492900:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.492908:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.492927:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff977858b3c400) 00010000:00010000:0.0:1788969963.492930:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788969963.492936:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.492943:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3bf3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969963.500949:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969963.501089:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732009728 00000100:00100000:0.0:1788969963.501099:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732009728 00000100:00100000:0.0:1788969963.501160:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:0.0:1788969963.501172:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:9676:x1875870732009728:12345-192.168.202.9@tcp:101:chmod.0 00010000:00010000:0.0:1788969963.501193:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969963.501217:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3bfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e850 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.501308:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b3c01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.501322:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b3c01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.501334:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b3c01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788969963.501371:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788969963.501375:0:7061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788969963.501410:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b3c01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.501437:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3bfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e850 expref: 8 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.501454:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b3c01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e850 expref: 7 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.501462:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672300) 00010000:00010000:0.0:1788969963.501465:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788969963.501468:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5a00, rc 0) 00000100:00100000:0.0:1788969963.501530:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:9676:x1875870732009728:12345-192.168.202.9@tcp:101:chmod.0 Request processed in 361us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969963.501537:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:3.0:1788969963.507756:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969963.507936:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732009984 00000100:00100000:0.0:1788969963.507945:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732009984 00000100:00100000:0.0:1788969963.508020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1788969963.508031:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:9676:x1875870732009984:12345-192.168.202.9@tcp:36:chmod.0 00010000:00010000:0.0:1788969963.508082:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969963.508109:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b3c01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e850 expref: 7 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.508129:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672300) 00010000:00010000:0.0:1788969963.508140:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788969963.508163:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.508175:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.508186:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788969963.508995:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097c44882 reply state 00000000a6abcbf9 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969963.509007:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788969963.509015:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788969963.509104:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:9676:x1875870732009984:12345-192.168.202.9@tcp:36:chmod.0 Request processed in 1074us (1366us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788969963.509113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00010000:00010000:1.0:1788969963.510236:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.510248:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.510255:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.510261:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969963.510266:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.510286:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.510302:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672600) 00010000:00010000:1.0:1788969963.510305:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788969963.510310:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.510317:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b3c08 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969963.535008:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969963.535212:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732010112 00000100:00100000:0.0:1788969963.535223:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732010112 00000100:00100000:0.0:1788969963.535295:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1788969963.535308:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:9677:x1875870732010112:12345-192.168.202.9@tcp:101:chown.0 00010000:00010000:0.0:1788969963.535353:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969963.535376:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b3c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e857 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.535451:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3c16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.535468:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.535480:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788969963.535518:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788969963.535522:0:7061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788969963.535572:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.535599:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b3c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e857 expref: 9 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.535617:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3c16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e857 expref: 8 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.535625:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672300) 00010000:00010000:0.0:1788969963.535628:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788969963.535632:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5c00, rc 0) 00000100:00100000:0.0:1788969963.535700:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:9677:x1875870732010112:12345-192.168.202.9@tcp:101:chown.0 Request processed in 396us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969963.535707:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:3.0:1788969963.538386:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969963.538597:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732010240 00000100:00100000:1.0:1788969963.538607:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732010240 00000100:00100000:1.0:1788969963.538713:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:1.0:1788969963.538724:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:9677:x1875870732010240:12345-192.168.202.9@tcp:101:chown.0 00010000:00010000:1.0:1788969963.538754:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969963.538784:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e85e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.538884:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.538897:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.538908:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.538923:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.538948:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.538954:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539058:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3c32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539066:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539073:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788969963.539101:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788969963.539105:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788969963.539125:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539137:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539145:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539151:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539158:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969963.539162:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539176:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539189:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672300) 00010000:00010000:1.0:1788969963.539191:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969963.539197:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539203:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539216:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539222:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539228:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539233:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969963.539236:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539241:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539249:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9778519ab800) 00010000:00010000:1.0:1788969963.539251:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969963.539254:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539269:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539300:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e85e expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539313:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e85e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.539319:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9778519aba00) 00010000:00010000:1.0:1788969963.539321:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788969963.539323:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92600, rc 0) 00000100:00100000:1.0:1788969963.539400:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:9677:x1875870732010240:12345-192.168.202.9@tcp:101:chown.0 Request processed in 670us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969963.539408:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:1.0:1788969963.542097:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969963.542175:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732010496 00000100:00100000:3.0:1788969963.542185:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732010496 00000100:00100000:3.0:1788969963.542241:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:3.0:1788969963.542251:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:9677:x1875870732010496:12345-192.168.202.9@tcp:36:chown.0 00010000:00010000:3.0:1788969963.542301:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969963.542324:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3c32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e85e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.542341:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9778519aba00) 00010000:00010000:3.0:1788969963.542351:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788969963.542373:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.542385:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.542420:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969963.577667:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969963.577717:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969963.577818:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732010752 00000100:00100000:1.0:1788969963.577829:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732010752 00000100:00100000:1.0:1788969963.577897:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:1.0:1788969963.577909:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732010752:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969963.577989:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732010752:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 83us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969963.577997:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00080000:1.0:1788969963.578017:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969963.578654:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732010624 00000100:00100000:2.0:1788969963.578660:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732010624 00000100:00100000:2.0:1788969963.578750:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 243 00000100:00100000:2.0:1788969963.578758:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732010624:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969963.578825:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732010624:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 67us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969963.578831:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 243 00000004:00010000:2.0:1788969963.582210:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee2e758f reply state 00000000cdbb811e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969963.582255:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788969963.582268:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788969963.582372:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:9677:x1875870732010496:12345-192.168.202.9@tcp:36:chown.0 Request processed in 40118us (40279us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788969963.582380:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000001:00080000:0.0:1788969963.582877:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1788969963.582902:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1788969963.582970:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.582980:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.582988:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.582995:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.582999:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.583006:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.583020:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3cd00) 00010000:00010000:3.0:1788969963.583024:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788969963.583029:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.583035:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969963.589293:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969963.606229:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969963.607113:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732010880 00000100:00100000:3.0:1788969963.607126:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732010880 00000100:00100000:3.0:1788969963.607215:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:3.0:1788969963.607226:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:9678:x1875870732010880:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1788969963.607259:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969963.607278:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e865 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788969963.611416:0:7061:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4079us 00010000:00010000:3.0:1788969963.632388:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632416:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632425:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632437:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632441:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632445:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632760:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b3c55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632769:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632776:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969963.632843:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788969963.632847:0:7061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788969963.632883:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632895:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632901:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632907:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632913:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841544200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.632918:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632925:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632935:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672300) 00010000:00010000:3.0:1788969963.632938:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969963.632944:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632950:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3c47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632961:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632976:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632981:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632986:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.632989:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.632995:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.633002:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff977858b3cd00) 00010000:00010000:3.0:1788969963.633005:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969963.633008:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.633014:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3c4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.633052:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3c40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e865 expref: 8 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.633068:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b3c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e865 expref: 7 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.633075:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:3.0:1788969963.633077:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788969963.633085:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8a00, rc 0) 00000100:00100000:3.0:1788969963.633155:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:9678:x1875870732010880:12345-192.168.202.9@tcp:101:touch.500 Request processed in 25929us (26936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969963.633165:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:3.0:1788969963.638760:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969963.639057:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732011136 00000100:00100000:1.0:1788969963.639067:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732011136 00000100:00100000:1.0:1788969963.639142:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:1.0:1788969963.639152:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:9678:x1875870732011136:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1788969963.639171:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969963.639193:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e86c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.640065:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.640083:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.640096:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.640133:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.640142:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.640149:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788969963.643208:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788969963.643508:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643525:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643538:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643583:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643590:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643597:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643603:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969963.643608:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643616:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643629:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:1.0:1788969963.643632:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969963.643638:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643644:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3c63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788969963.643660:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002943e2c reply state 000000004929377e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969963.643669:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788969963.643704:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e86c expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643730:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e86c expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.643752:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788969963.643754:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788969963.643757:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92e00, rc 0) 00000100:00100000:1.0:1788969963.644448:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:9678:x1875870732011136:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5295us (5696us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788969963.644458:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00010000:00010000:1.0:1788969963.647164:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.647181:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.647189:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.647195:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969963.647210:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.647219:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.647234:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9778519ab900) 00010000:00010000:1.0:1788969963.647237:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969963.647242:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.647260:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969963.655379:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969963.655453:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732011392 00000100:00100000:1.0:1788969963.655463:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732011392 00000100:00100000:1.0:1788969963.655524:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:1.0:1788969963.655533:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:9678:x1875870732011392:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1788969963.655580:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969963.655602:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e86c expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.655614:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788969963.655621:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788969963.655654:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.655669:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.655675:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788969963.655993:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030bf9162 reply state 000000003f6d28b2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969963.656003:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788969963.656131:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:9678:x1875870732011392:12345-192.168.202.9@tcp:36:touch.500 Request processed in 598us (761us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788969963.656138:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:0.0:1788969963.660682:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969963.661211:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732011520 00000100:00100000:2.0:1788969963.661221:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732011520 00000100:00100000:2.0:1788969963.661311:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:2.0:1788969963.661322:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:9678:x1875870732011520:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1788969963.661354:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969963.661379:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b3c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e873 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.661435:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b3c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e873 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.661453:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b3c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e873 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.661473:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9778519ab900) 00010000:00010000:2.0:1788969963.661477:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788969963.661480:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031a00, rc 0) 00000100:00100000:2.0:1788969963.661532:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:9678:x1875870732011520:12345-192.168.202.9@tcp:101:touch.500 Request processed in 212us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969963.661539:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00010000:00010000:3.0:1788969963.662652:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.662666:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.662674:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.662681:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.662685:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.662692:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.662705:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9778519ab900) 00010000:00010000:3.0:1788969963.662708:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969963.662713:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.662719:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3c7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969963.675020:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969963.677696:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732011648 00000100:00100000:3.0:1788969963.677711:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732011648 00000100:00100000:3.0:1788969963.677834:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:3.0:1788969963.677844:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977861e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875870732011648:12345-192.168.202.9@tcp:8:touch.500 00010000:00080000:3.0:1788969963.677877:0:6679:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:3.0:1788969963.677912:0:6679:0:(genops.c:1384:class_connect()) connect: client c7778032-abf5-4f7d-b43e-a87bfd7b090c, cookie 0x5d0de860b05b3c8d 00002000:00100000:3.0:1788969963.677924:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c7778032-abf5-4f7d-b43e-a87bfd7b090c/ffff97787f945800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788969963.677948:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1788969963.678173:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788969963.678217:0:6679:0:(import.c:65:import_set_state_nolock()) ffff97787f946800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788969963.678836:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977861e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2352:x1875870732011648:12345-192.168.202.9@tcp:8:touch.500 Request processed in 990us (3823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969963.678845:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:3.0:1788969963.688056:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969963.688143:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732011776 00000100:00100000:0.0:1788969963.688155:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732011776 00000100:00100000:0.0:1788969963.688953:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1788969963.688964:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:0:x1875870732011776:12345-192.168.202.9@tcp:2:touch.500 00000100:00080000:1.0:1788969963.692105:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788969963.728716:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:0:x1875870732011776:12345-192.168.202.9@tcp:2:touch.500 Request processed in 39743us (40658us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788969963.728727:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000001:00080000:1.0:1788969963.728929:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1788969963.728941:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000100:00100000:2.0:1788969963.739925:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969963.740050:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732012032 00000100:00100000:0.0:1788969963.740060:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732012032 00000100:00100000:0.0:1788969963.740120:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:0.0:1788969963.740131:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:9678:x1875870732012032:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1788969963.740543:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:9678:x1875870732012032:12345-192.168.202.9@tcp:35:touch.500 Request processed in 412us (626us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788969963.740551:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:2.0:1788969963.763431:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969963.763530:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732012160 00000100:00100000:1.0:1788969963.763540:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732012160 00000100:00100000:1.0:1788969963.763599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:1.0:1788969963.763608:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:9679:x1875870732012160:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:1.0:1788969963.763631:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969963.763652:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3c94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e87a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.763716:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.763730:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.763754:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788969963.763827:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788969963.763831:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788969963.763897:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.763925:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3c94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e87a expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.763958:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e87a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.763967:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:1.0:1788969963.763969:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788969963.763973:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93400, rc 0) 00000100:00100000:1.0:1788969963.764038:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:9679:x1875870732012160:12345-192.168.202.9@tcp:101:rm.0 Request processed in 427us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969963.764045:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:3.0:1788969963.769074:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969963.773537:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732012416 00000100:00100000:2.0:1788969963.773554:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732012416 00000100:00100000:2.0:1788969963.773629:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:2.0:1788969963.773639:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:9679:x1875870732012416:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:2.0:1788969963.773661:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969963.773684:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3ca2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e881 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788969963.773784:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788969963.773973:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3ca2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e881 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.773988:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672300) 00010000:00010000:2.0:1788969963.773991:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788969963.773997:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3ca2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e881 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.774013:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031200, rc 0) 00000100:00100000:2.0:1788969963.774091:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:9679:x1875870732012416:12345-192.168.202.9@tcp:101:rm.0 Request processed in 453us (5027us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788969963.774098:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:2.0:1788969963.787369:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969963.789433:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732012544 00000100:00100000:1.0:1788969963.789446:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732012544 00000100:00100000:1.0:1788969963.789521:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:1.0:1788969963.789530:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:9679:x1875870732012544:12345-192.168.202.9@tcp:37:rm.0 00000100:00100000:1.0:1788969963.798226:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:9679:x1875870732012544:12345-192.168.202.9@tcp:37:rm.0 Request processed in 8685us (10855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969963.798252:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:3.0:1788969963.804911:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969963.805032:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732012800 00000100:00100000:0.0:1788969963.805042:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732012800 00000100:00100000:0.0:1788969963.805108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1788969963.805120:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:9679:x1875870732012800:12345-192.168.202.9@tcp:35:rm.0 00000100:00100000:0.0:1788969963.805388:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:9679:x1875870732012800:12345-192.168.202.9@tcp:35:rm.0 Request processed in 270us (486us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788969963.805396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1788969963.810060:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969963.810356:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732013056 00000100:00100000:1.0:1788969963.810367:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732013056 00000100:00100000:1.0:1788969963.810550:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:1.0:1788969963.810563:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:9679:x1875870732013056:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:1.0:1788969963.810589:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969963.810611:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3cb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e888 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.810709:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3cb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.810748:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.810761:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788969963.810773:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788969963.810947:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3cb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e888 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.810967:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e888 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.810976:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:1.0:1788969963.810979:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788969963.810982:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93e00, rc 0) 00000100:00100000:1.0:1788969963.811045:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:9679:x1875870732013056:12345-192.168.202.9@tcp:101:rm.0 Request processed in 486us (995us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788969963.811051:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:3.0:1788969963.818913:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969963.819059:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732013184 00000100:00100000:2.0:1788969963.819069:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732013184 00000100:00100000:2.0:1788969963.819132:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:2.0:1788969963.819143:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:9679:x1875870732013184:12345-192.168.202.9@tcp:41:rm.0 00000004:00000024:2.0:1788969963.819257:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788969963.819330:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:9679:x1875870732013184:12345-192.168.202.9@tcp:41:rm.0 Request processed in 188us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969963.819338:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:2.0:1788969963.825758:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969963.826121:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732013312 00000100:00100000:3.0:1788969963.826132:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732013312 00000100:00100000:3.0:1788969963.826211:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:3.0:1788969963.826222:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:9679:x1875870732013312:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:3.0:1788969963.826261:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969963.826284:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3cc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e88f expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826353:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826392:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826404:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826425:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826432:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826439:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826542:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3cda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826550:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826557:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969963.826582:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788969963.826586:0:7061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788969963.826607:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826618:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826638:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826645:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826651:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826657:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.826662:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826669:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826681:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:3.0:1788969963.826684:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969963.826689:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826695:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3ccc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826708:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826715:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826722:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826745:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.826749:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826755:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826764:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff977858b3c200) 00010000:00010000:3.0:1788969963.826766:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969963.826770:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826775:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826857:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3cc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e88f expref: 18 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826873:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3cda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e88f expref: 17 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.826880:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9778519ab900) 00010000:00010000:3.0:1788969963.826883:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788969963.826885:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977841545400, rc 0) 00000100:00100000:3.0:1788969963.826942:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:9679:x1875870732013312:12345-192.168.202.9@tcp:101:rm.0 Request processed in 722us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969963.826949:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:3.0:1788969963.830347:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969963.830463:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732013568 00000100:00100000:2.0:1788969963.830472:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732013568 00000100:00100000:2.0:1788969963.830535:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:2.0:1788969963.830545:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:9679:x1875870732013568:12345-192.168.202.9@tcp:36:rm.0 00010000:00010000:2.0:1788969963.830598:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788969963.830624:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841545400/0x5d0de860b05b3cda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e88f expref: 17 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830648:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b3c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e873 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830661:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9778519ab900) 00010000:00010000:2.0:1788969963.830679:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3c9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e87a expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830690:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788969963.830693:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788969963.830712:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830725:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830759:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830777:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830786:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830840:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830942:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830951:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.830958:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788969963.831669:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788969963.831680:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 275794890267ns, next at 276794888128ns, rc = 0 00010000:00010000:2.0:1788969963.831762:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831773:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831781:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831826:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831832:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831838:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831861:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788969963.831880:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831885:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831891:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831896:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788969963.831900:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831907:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831916:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff977843e0b500) 00010000:00010000:2.0:1788969963.831919:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788969963.831923:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831938:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b3cef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831955:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831961:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831967:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831973:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788969963.831976:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831982:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.831989:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788969963.831992:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788969963.831995:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969963.832000:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b3ce1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788969963.832010:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe400c2d reply state 0000000064801830 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969963.832019:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788969963.832099:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:9679:x1875870732013568:12345-192.168.202.9@tcp:36:rm.0 Request processed in 1553us (1759us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788969963.832107:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00010000:00010000:3.0:1788969963.832280:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788969963.832287:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.832293:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44ca00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788969963.832296:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.832303:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.832313:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff977843e0b500) 00010000:00010000:3.0:1788969963.832315:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788969963.832318:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.832325:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b3cf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.832340:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969963.832342:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969963.832344:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969963.835227:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969963.835666:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732013824 00000100:00100000:0.0:1788969963.835694:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732013824 00000100:00100000:0.0:1788969963.835774:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1788969963.835785:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:9679:x1875870732013824:12345-192.168.202.9@tcp:35:rm.0 00000100:00100000:0.0:1788969963.836040:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:9679:x1875870732013824:12345-192.168.202.9@tcp:35:rm.0 Request processed in 256us (821us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788969963.836047:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00010000:00010000:1.0:1788969963.838613:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.838632:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.838640:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.838646:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969963.838668:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.838677:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.838692:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff977843e0b800) 00010000:00010000:1.0:1788969963.838696:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969963.838703:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969963.838710:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b3ce8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969963.838765:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969963.838870:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732014080 00000100:00100000:3.0:1788969963.838878:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732014080 00000100:00100000:3.0:1788969963.838923:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:3.0:1788969963.838932:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:9679:x1875870732014080:12345-192.168.202.9@tcp:36:rm.0 00010000:00010000:3.0:1788969963.838985:0:7061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788969963.839003:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3cb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e888 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839033:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b3c55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e865 expref: 15 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839044:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:3.0:1788969963.839056:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3c16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e857 expref: 14 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839064:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672300) 00010000:00010000:3.0:1788969963.839071:0:7061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788969963.839093:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839105:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839114:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839126:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839132:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839139:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839583:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839601:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.839608:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969963.842169:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788969963.842192:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842214:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842222:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842228:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.842232:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842247:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842261:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff977858b3c000) 00010000:00010000:3.0:1788969963.842264:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788969963.842268:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842274:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842301:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842314:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842319:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842324:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.842328:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842333:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842341:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:3.0:1788969963.842343:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969963.842351:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.842357:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841545e00/0x5d0de860b05b3cfd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788969963.842370:0:7061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ca57117 reply state 000000000ec44dc0 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969963.842379:0:7061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788969963.844829:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:9679:x1875870732014080:12345-192.168.202.9@tcp:36:rm.0 Request processed in 5886us (6056us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788969963.844843:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00010000:00010000:3.0:1788969963.849688:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.849729:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.849748:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.849754:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841544200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969963.849759:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.849767:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.849783:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff977858b3cd00) 00010000:00010000:3.0:1788969963.849786:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969963.849913:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969963.849920:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977841544200/0x5d0de860b05b3d04 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969963.973187:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788969963.973223:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741480064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788969963.973304:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969963.973587:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741480064 00000100:00100000:3.0:1788969963.973596:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741480064 00000100:00100000:3.0:1788969963.973666:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788969963.973676:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741480064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788969963.973698:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969963.973758:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741480064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969963.973766:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788969963.974137:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788969963.974173:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97784eb8fc00 x1875870741480064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969963.974262:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741480064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788969963.974598:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741480192:0@lo:400:kworker.0 00000100:00100000:3.0:1788969963.974639:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969963.974677:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741480704:0@lo:400:kworker.0 00000100:00100000:3.0:1788969963.974702:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969963.974726:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788969963.974744:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741480320:0@lo:400:kworker.0 00000100:00100000:3.0:1788969963.974767:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969963.974883:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741480704 00000100:00100000:3.0:1788969963.974889:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741480704 00000100:00100000:3.0:1788969963.974922:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741480320 00000100:00100000:3.0:1788969963.974924:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741480320 00000100:00100000:3.0:1788969963.974944:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788969963.974951:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741480704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969963.974992:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741480704:12345-0@lo:400:kworker.0 Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969963.974998:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788969963.975012:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788969963.975018:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741480320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969963.975042:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741480320:12345-0@lo:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969963.975047:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788969963.975074:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741480320:0@lo:400:kworker.0 00000100:00100000:3.0:1788969963.975084:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741480704:0@lo:400:kworker.0 00000100:00080000:1.0:1788969963.975162:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969963.975172:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741480448:0@lo:400:kworker.0 00000100:00100000:1.0:1788969963.975283:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969963.975310:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788969963.975327:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741480576:0@lo:400:kworker.0 00000100:00100000:1.0:1788969963.975435:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969963.975466:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741480576 00000100:00100000:1.0:1788969963.975470:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741480576 00000100:00100000:1.0:1788969963.975515:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788969963.975520:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741480576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969963.975556:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741480576:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969963.975562:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788969963.975594:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787dcb5a40 x1875870741480576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969963.975604:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741480576:0@lo:400:kworker.0 00000100:00100000:0.0:1788969963.975756:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741480192 00000100:00100000:0.0:1788969963.975761:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741480192 00000100:00100000:0.0:1788969963.976009:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788969963.976017:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741480192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969963.976064:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741480192:12345-0@lo:400:kworker.0 Request processed in 48us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969963.976070:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788969963.976096:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741480448 00000100:00100000:0.0:1788969963.976099:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741480448 00000100:00100000:0.0:1788969963.976127:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788969963.976133:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741480448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969963.976163:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741480448:12345-0@lo:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969963.976169:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788969963.976628:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969963.976653:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741480448:0@lo:400:kworker.0 00000100:00100000:0.0:1788969963.977469:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741480192:0@lo:400:kworker.0 00010000:00010000:2.0:1788969964.612994:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969965.638140:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969966.663995:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969967.685004:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969968.073333:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741480832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788969968.073401:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969968.073857:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741480832 00000100:00100000:2.0:1788969968.073868:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741480832 00000100:00100000:2.0:1788969968.073958:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788969968.073968:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741480832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788969968.074004:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788969968.074054:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741480832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969968.074061:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788969968.074762:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788969968.074826:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778616d5a40 x1875870741480832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969968.074845:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741480832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969968.703142:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969968.703188:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969968.703216:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969968.703245:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969968.703724:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732014336 00000100:00100000:3.0:1788969968.703756:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732014336 00000100:00100000:3.0:1788969968.703851:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732014592 00000100:00100000:3.0:1788969968.703856:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732014592 00000100:00100000:3.0:1788969968.703883:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:3.0:1788969968.703893:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:2354:x1875870732014336:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969968.703953:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732014464 00000100:00100000:2.0:1788969968.703959:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732014464 00000100:00100000:2.0:1788969968.704000:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:3.0:1788969968.704010:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:2354:x1875870732014336:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 116us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969968.704012:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732014464:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969968.704024:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:3.0:1788969968.704048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:2.0:1788969968.704053:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732014464:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 43us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969968.704059:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732014592:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969968.704066:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:3.0:1788969968.704092:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732014592:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 36us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969968.704099:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00080000:1.0:1788969968.705965:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788969968.705979:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788969968.713861:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1788969968.713901:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788969968.713918:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1788969968.714068:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788969968.714100:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741480960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788969968.714183:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788969968.714731:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969968.718860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732014208 00000100:00100000:0.0:1788969968.718882:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732014208 00000100:00100000:2.0:1788969968.719242:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 245 00000100:00100000:2.0:1788969968.719265:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732014208:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969968.719369:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732014208:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 115us (16241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969968.719377:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 245 00000100:00100000:0.0:1788969968.720101:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741480960 00000100:00100000:0.0:1788969968.720109:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741480960 00000100:00100000:0.0:1788969968.720161:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788969968.720169:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741480960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788969968.720228:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788969968.720301:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa183ec, atime: 0x6aa183ec, ctime: 0x6aa183ec, blocks: 0x1 00010000:00010000:0.0:1788969968.720311:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969968.720332:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1788969968.720337:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788969968.720344:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969968.720365:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969968.720375:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969968.720397:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969968.720418:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788969968.723931:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741480960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3747us (9733us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788969968.723952:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788969968.724277:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97787857c3c0/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788969968.724287:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741480960:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788969968.725107:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788969968.725120:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969968.725137:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788969968.725143:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969968.725156:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969968.725199:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969968.725208:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000729e98d5/0x5d0de860b05b3d12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969968.725263:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969968.725265:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788969968.725266:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788969968.725996:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788969969.094876:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741481472:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.094970:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969969.095040:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788969969.095048:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741481088:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095078:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969969.095105:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741481600:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095132:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969969.095159:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741481216:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095183:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969969.095202:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741481728:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095223:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969969.095241:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788969969.095246:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741481344:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095289:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969969.095330:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741481472 00000100:00100000:2.0:1788969969.095341:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741481472 00000100:00100000:2.0:1788969969.095394:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741481728 00000100:00100000:2.0:1788969969.095398:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741481728 00000100:00100000:2.0:1788969969.095422:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788969969.095432:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741481472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095495:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741481472:12345-0@lo:400:kworker.0 Request processed in 64us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969969.095513:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788969969.095532:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788969969.095537:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875870741481728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095570:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875870741481728:12345-0@lo:400:kworker.0 Request processed in 33us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969969.095576:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788969969.095595:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741481088 00000100:00100000:2.0:1788969969.095599:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741481088 00000100:00100000:2.0:1788969969.095620:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788969969.095626:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741481088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095656:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741481088:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969969.095662:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788969969.095704:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741481600 00000100:00100000:2.0:1788969969.095708:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741481600 00000100:00100000:2.0:1788969969.095745:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741481216 00000100:00100000:2.0:1788969969.095748:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741481216 00000100:00100000:2.0:1788969969.095760:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741481344 00000100:00100000:2.0:1788969969.095762:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741481344 00000100:00100000:2.0:1788969969.095776:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788969969.095782:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741481600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095838:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741481600:12345-0@lo:400:kworker.0 Request processed in 54us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969969.095844:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788969969.095856:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788969969.095862:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741481216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095899:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741481216:12345-0@lo:400:kworker.0 Request processed in 38us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969969.095905:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788969969.095917:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788969969.095923:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741481344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.095948:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741481344:12345-0@lo:400:kworker.0 Request processed in 25us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969969.095954:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788969969.095996:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969969.096039:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741481344:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.096052:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741481216:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.096064:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741481728:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.096099:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741481088:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.096111:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741481600:0@lo:400:kworker.0 00010000:00080000:2.0:1788969969.096124:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787857f0c0 x1875870741481472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969969.096135:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741481472:0@lo:400:kworker.0 00000100:00100000:2.0:1788969969.102351:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741481856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969969.102445:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969969.102562:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741481856 00000100:00100000:3.0:1788969969.102572:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741481856 00000100:00100000:3.0:1788969969.102638:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788969969.102649:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875870741481856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788969969.102705:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969969.102761:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875870741481856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969969.102770:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788969969.102903:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741481856:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788969969.219575:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:02000400:0.0:1788969969.234121:0:11593:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788969969.733074:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788969970.693364:0:11641:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd01049e20 20000000:00000080:0.0:1788969970.693381:0:11641:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff977865198c00 uarg=0000000000000000 20000000:01000000:0.0:1788969970.693425:0:11641:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788969970.693431:0:11641:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788969970.693435:0:11641:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788969970.697275:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788969970.710119:0:11641:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788969970.718464:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788969970.718524:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788969970.718599:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788969970.718620:0:11641:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788969970.718641:0:11641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.718661:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e842 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.718684:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e849 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.718691:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3bc2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.718698:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3bd0 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.718927:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3bde expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.718935:0:11641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.718978:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3bde expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.718997:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3bde expref: 18 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969970.719013:0:11641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865086d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741481984:0@lo:104: 00000100:00100000:2.0:1788969970.719078:0:11641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788969970.719160:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3bd0 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.719292:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3bd0 expref: 18 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969970.719302:0:11641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865084780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741482112:0@lo:104: 00000100:00100000:2.0:1788969970.719328:0:11641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788969970.719369:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b3bc2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.719378:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b3bc2 expref: 18 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969970.719386:0:11641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865084000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741482240:0@lo:104: 00000100:00100000:2.0:1788969970.719410:0:11641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788969970.719515:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e849 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.719526:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e849 expref: 12 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969970.719535:0:11641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865086940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741482368:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788969970.719872:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e842 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.719880:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e842 expref: 12 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969970.719888:0:11641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741482496:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788969970.719932:0:11641:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1788969970.720923:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788969970.720940:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741481984 00000100:00100000:3.0:1788969970.720947:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741481984 00000100:00100000:3.0:1788969970.720987:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741482112 00000100:00100000:3.0:1788969970.721000:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741482112 00000100:00100000:3.0:1788969970.721014:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741482240 00000100:00100000:3.0:1788969970.721017:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741482240 00000100:00100000:3.0:1788969970.721031:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788969970.721039:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:11641:x1875870741481984:12345-0@lo:104: 00010000:00010000:3.0:1788969970.721053:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969970.721209:0:7605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788969970.721220:0:7605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865087c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:11641:x1875870741482112:12345-0@lo:104: 00010000:00010000:1.0:1788969970.721228:0:7605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.721305:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788969970.721311:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+5:11641:x1875870741481984:12345-0@lo:104: Request processed in 273us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969970.721318:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788969970.721336:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788969970.721342:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865199050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:11641:x1875870741482240:12345-0@lo:104: 00010000:00010000:3.0:1788969970.721350:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730106:0:7605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788969970.730125:0:7605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865087c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+4:11641:x1875870741482112:12345-0@lo:104: Request processed in 8904us (10791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969970.730137:0:7605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788969970.730193:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788969970.730203:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730214:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545000 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788969970.730219:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730231:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788969970.730238:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969970.730243:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788969970.730307:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730314:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788969970.730336:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730343:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545000/0x5d0de860b05b3bde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3be5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730378:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788969970.730382:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730387:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5600 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788969970.730390:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730396:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788969970.730402:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969970.730407:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788969970.730422:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730427:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788969970.730434:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730440:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5600/0x5d0de860b05b3bd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3bd7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.730448:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969970.730450:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969970.730452:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969970.730481:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741482624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788969970.730550:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969970.730861:0:11641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865086d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741481984:0@lo:104: 00000100:00100000:2.0:1788969970.730892:0:11641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865084780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741482112:0@lo:104: 00010000:00010000:3.0:1788969970.731261:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788969970.731269:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865199050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d87485c-d221-41b3-b6c0-56f4dfc97796+3:11641:x1875870741482240:12345-0@lo:104: Request processed in 9926us (11857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969970.731277:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788969970.731444:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1788969970.731461:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788969970.731465:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731473:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4a00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788969970.731476:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731494:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788969970.731501:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969970.731506:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788969970.731530:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731536:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788969970.731551:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731557:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff4a00/0x5d0de860b05b3bc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b3bc9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731576:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969970.731578:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788969970.731579:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788969970.731594:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741482624 00000100:00100000:3.0:1788969970.731600:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741482624 00010000:00010000:3.0:1788969970.731623:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3bde expref: 19 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969970.731643:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732014720 00000100:00100000:3.0:1788969970.731645:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732014720 00010000:00010000:3.0:1788969970.731655:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e849 expref: 13 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969970.731682:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788969970.731698:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741482624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788969970.731718:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969970.731724:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3bde expref: 19 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731734:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3bde expref: 19 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731746:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840030e00/0x5d0de860b05b3be5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3bde expref: 19 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731757:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788969970.731864:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3283:x1875870741482624:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969970.731871:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788969970.731885:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:3.0:1788969970.731891:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732014720:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788969970.731899:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969970.731903:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e849 expref: 13 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731911:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e849 expref: 13 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969970.731922:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788969970.731958:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732014720:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 66us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969970.731966:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:3.0:1788969970.731995:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741482880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788969970.732024:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969970.732108:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741482624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788969970.732128:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788969970.732134:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741482752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788969970.732156:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969970.732182:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741482880 00000100:00100000:1.0:1788969970.732185:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741482880 00010000:00010000:1.0:1788969970.732200:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3bc2 expref: 18 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969970.732212:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741482752 00000100:00100000:1.0:1788969970.732215:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741482752 00010000:00010000:1.0:1788969970.732225:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3bd0 expref: 19 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969970.732237:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788969970.732242:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778600e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741482880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788969970.732249:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969970.732253:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3bc2 expref: 19 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.732260:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3bc2 expref: 19 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.732269:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969970.732290:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778600e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741482880:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969970.732297:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788969970.732330:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788969970.732343:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa14b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3283:x1875870741482752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788969970.732350:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969970.732354:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b3bd0 expref: 18 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.732363:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b3bd0 expref: 18 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.732373:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841544600/0x5d0de860b05b3bd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3bd0 expref: 18 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.732382:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969970.732409:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa14b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:3283:x1875870741482752:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969970.732415:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788969970.732441:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969970.732455:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741482752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788969970.732680:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741482880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788969970.733125:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841545200/0x5d0de860b05b3bc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b3bc2 expref: 16 pid: 5827 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969970.733233:0:11641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865084000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741482240:0@lo:104: 00010000:00010000:2.0:1788969970.733250:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841544a00/0x5d0de860b05b3bbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e849 expref: 12 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969970.733259:0:11641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865086940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741482368:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788969970.738463:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969970.738533:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732014848 00000100:00100000:1.0:1788969970.738543:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732014848 00010000:00010000:1.0:1788969970.738582:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e842 expref: 12 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969970.738632:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:1.0:1788969970.738642:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:2353:x1875870732014848:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788969970.738657:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969970.738663:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e842 expref: 12 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.738925:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e842 expref: 12 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.738950:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.738958:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.738977:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.738983:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.738990:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.738997:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.739002:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44de00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788969970.739006:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.739014:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.739023:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969970.739045:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969970.739103:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:2353:x1875870732014848:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 463us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969970.739111:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00010000:00010000:2.0:1788969970.739355:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b3bb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e842 expref: 11 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969970.739385:0:11641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875870741482496:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788969970.739414:0:11641:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.739422:0:11641:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.739428:0:11641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969970.739434:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d19 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969970.767676:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969971.784439:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788969971.909060:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788969971.909069:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97784c0a0000 from 7 10000000:01000000:1.0:1788969971.909074:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788969971.909200:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969971.909214:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969971.909410:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969971.909498:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788969971.909568:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969971.909712:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952240 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.922956:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741483008 00000100:00100000:0.0:1788969971.922975:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741483008 00000100:00100000:0.0:1788969971.923060:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788969971.923070:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:5829:x1875870741483008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969971.923087:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969971.923109:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff5600/0x5d0de860b05b3d27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3d20 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.923157:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5600/0x5d0de860b05b3d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3d20 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.923175:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff5600/0x5d0de860b05b3d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3d20 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.923184:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5600, rc 0) 00000100:00100000:0.0:1788969971.923280:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741483008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (13712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.923288:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788969971.923773:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788969971.923818:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969971.923830:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969971.923920:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969971.923974:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969971.924021:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952240 going to sleep for 11 seconds 00000100:00100000:3.0:1788969971.924089:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741483136 00000100:00100000:3.0:1788969971.924095:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741483136 00000100:00100000:3.0:1788969971.924131:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788969971.924138:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741483136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969971.924432:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741483136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969971.924439:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788969971.925190:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969971.925240:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969971.925288:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969971.925330:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952240 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.925645:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741483264 00000100:00100000:0.0:1788969971.925651:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741483264 00000100:00100000:0.0:1788969971.925691:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788969971.925699:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741483264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969971.925927:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741483264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.925941:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788969971.926716:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788969971.927377:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11654:1875870741483392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969971.927442:0:11654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969971.927483:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.927684:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741483392 00000100:00100000:0.0:1788969971.927691:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741483392 00000100:00100000:0.0:1788969971.927736:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788969971.927745:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:11654:x1875870741483392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969971.928011:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:11654:x1875870741483392:12345-0@lo:502:llog_process_th.0 Request processed in 267us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.928020:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788969971.928460:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11654:1875870741483392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788969971.928491:0:11654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788969971.928501:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969971.928503:0:11654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788969971.928510:0:11654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97784c0a0000 00000020:00000080:1.0:1788969971.928512:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788969971.928599:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11654:1875870741483520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969971.928638:0:11654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969971.928684:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788969971.928811:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741483520 00000100:00100000:3.0:1788969971.928817:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741483520 00000100:00100000:3.0:1788969971.928863:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788969971.928870:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:11654:x1875870741483520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788969971.929005:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:11654:x1875870741483520:12345-0@lo:502:llog_process_th.0 Request processed in 135us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969971.929023:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788969971.930590:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11654:1875870741483520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788969971.930634:0:11654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788969971.930642:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788969971.930645:0:11654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788969971.930649:0:11654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788969971.931971:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788969971.932000:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788969971.932012:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969971.932025:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788969971.932036:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788969971.932053:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9778601fa800 from 7 10000000:01000000:3.0:1788969971.932056:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788969971.932093:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969971.932101:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969971.932110:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969971.932145:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788969971.933550:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969971.933588:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.933894:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741483648 00000100:00100000:0.0:1788969971.933903:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741483648 00000100:00100000:0.0:1788969971.933954:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788969971.933964:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:5829:x1875870741483648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969971.933979:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969971.933995:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b3d35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3d2e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.934021:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b3d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3d2e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.934031:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b3d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3d2e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.934039:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4a00, rc 0) 00000100:00100000:0.0:1788969971.934081:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741483648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.934088:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788969971.934539:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788969971.934556:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969971.934565:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969971.934629:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969971.934674:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969971.934703:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.936545:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741483776 00000100:00100000:0.0:1788969971.936564:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741483776 00000100:00100000:0.0:1788969971.936616:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788969971.936625:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741483776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969971.936970:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741483776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.936979:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788969971.937200:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788969971.943597:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969971.943713:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969971.943764:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.944561:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741483904 00000100:00100000:0.0:1788969971.944571:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741483904 00000100:00100000:0.0:1788969971.944633:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788969971.944643:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741483904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969971.944912:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741483904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.944920:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788969971.948694:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741483904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788969971.961472:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11655:1875870741484032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788969971.961573:0:11655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969971.961617:0:11655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.961699:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741484032 00000100:00100000:0.0:1788969971.961707:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741484032 00000100:00100000:0.0:1788969971.961761:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788969971.961770:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:11655:x1875870741484032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969971.962038:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:11655:x1875870741484032:12345-0@lo:502:llog_process_th.0 Request processed in 270us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.962047:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788969971.962651:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11655:1875870741484032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788969971.962695:0:11655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788969971.962705:0:11655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969971.962707:0:11655:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788969971.962714:0:11655:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9778601fa800 00000020:00000080:2.0:1788969971.962717:0:11655:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788969971.962823:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11655:1875870741484160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788969971.962876:0:11655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969971.962901:0:11655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.967698:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741484160 00000100:00100000:0.0:1788969971.967715:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741484160 00000100:00100000:0.0:1788969971.967776:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788969971.967801:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:11655:x1875870741484160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788969971.976241:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:11655:x1875870741484160:12345-0@lo:502:llog_process_th.0 Request processed in 8438us (13345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969971.976264:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788969971.976674:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11655:1875870741484160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788969971.976713:0:11655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788969971.976722:0:11655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788969971.976724:0:11655:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788969971.976729:0:11655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788969971.977029:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788969971.977050:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788969971.977060:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969971.977072:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788969971.977083:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788969971.977086:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97786f03a800 from 7 10000000:01000000:1.0:1788969971.977089:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788969971.977134:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969971.977142:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969971.977151:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969971.977173:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741484288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788969971.977215:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969971.977493:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.977544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741484288 00000100:00100000:0.0:1788969971.977552:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741484288 00000100:00100000:0.0:1788969971.977615:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788969971.977623:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:5829:x1875870741484288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969971.977635:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969971.977647:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3d43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b3d3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.977701:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3d43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b3d3c expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.977712:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3d43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b3d3c expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.977720:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4e00, rc 0) 00000100:00100000:0.0:1788969971.977767:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741484288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.977774:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788969971.979945:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741484288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788969971.979974:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969971.979986:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969971.980069:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741484416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788969971.980683:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969971.980737:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1788969971.984623:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741484416 00000100:00100000:1.0:1788969971.984639:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741484416 00000100:00100000:1.0:1788969971.984745:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788969971.984756:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741484416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969971.985138:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741484416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 383us (4456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969971.985154:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788969971.986245:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741484416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788969971.986320:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741484544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788969971.986379:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969971.986418:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.987287:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741484544 00000100:00100000:0.0:1788969971.987296:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741484544 00000100:00100000:0.0:1788969971.987350:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788969971.987360:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741484544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969971.987564:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:5829:x1875870741484544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.987572:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788969971.987629:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d87485c-d221-41b3-b6c0-56f4dfc97796:5829:1875870741484544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969971.987853:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11658:1875870741484672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969971.987892:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969971.987910:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741484672 00000100:00100000:0.0:1788969971.987919:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741484672 00000100:00100000:0.0:1788969971.987939:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788969971.987945:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:11658:x1875870741484672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969971.988063:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:11658:x1875870741484672:12345-0@lo:502:llog_process_th.0 Request processed in 117us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.988070:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788969971.988104:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778436d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.988117:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11658:1875870741484672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788969971.988138:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788969971.988147:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788969971.988149:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788969971.988156:0:11658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97786f03a800 00000020:00000080:0.0:1788969971.988158:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788969971.988248:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11658:1875870741484800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969971.988279:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969971.988298:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741484800 00000100:00100000:0.0:1788969971.988302:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741484800 00000100:00100000:0.0:1788969971.988318:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788969971.988323:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:11658:x1875870741484800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788969971.988419:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:11658:x1875870741484800:12345-0@lo:502:llog_process_th.0 Request processed in 95us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969971.988425:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788969971.988451:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778436d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788969971.988462:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d87485c-d221-41b3-b6c0-56f4dfc97796:11658:1875870741484800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788969971.988479:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788969971.988483:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788969971.988489:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788969971.988493:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788969971.988538:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788969971.988557:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788969971.988566:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969971.988577:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788969972.015913:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788969972.048883:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969972.049328:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732014976 00000100:00100000:2.0:1788969972.049339:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732014976 00000100:00100000:2.0:1788969972.049413:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 262 00000100:00100000:2.0:1788969972.049423:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:5598:x1875870732014976:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788969972.049438:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969972.049454:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e896 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969972.049481:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e896 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969972.049492:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e896 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969972.049501:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44de00, rc 0) 00000100:00100000:2.0:1788969972.049544:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732014976:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 124us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969972.049551:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 262 00000100:00100000:3.0:1788969972.059231:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969972.059354:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732015104 00000100:00100000:0.0:1788969972.059374:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732015104 00000100:00100000:0.0:1788969972.059430:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 263 00000100:00100000:0.0:1788969972.059440:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732015104:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788969972.059752:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732015104:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 312us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969972.059760:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 263 00000100:00100000:3.0:1788969972.065991:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969972.066208:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732015232 00000100:00100000:0.0:1788969972.066218:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732015232 00000100:00100000:0.0:1788969972.066267:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 264 00000100:00100000:0.0:1788969972.066277:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732015232:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788969972.066892:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732015232:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 614us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969972.066901:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 264 00000100:00100000:3.0:1788969972.071756:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969972.073069:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732015360 00000100:00100000:0.0:1788969972.073082:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732015360 00000100:00100000:0.0:1788969972.073151:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 265 00000100:00100000:0.0:1788969972.073161:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:9949:x1875870732015360:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788969972.073582:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:9949:x1875870732015360:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 421us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969972.073591:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 265 00000100:00100000:0.0:1788969972.077132:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969972.077255:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732015488 00000100:00100000:1.0:1788969972.077266:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732015488 00000100:00100000:1.0:1788969972.079077:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 266 00000100:00100000:1.0:1788969972.079098:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:9949:x1875870732015488:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788969972.080756:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:9949:x1875870732015488:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 272us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969972.080772:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 266 00000100:00100000:3.0:1788969972.106207:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969972.106413:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732015616 00000100:00100000:0.0:1788969972.106425:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732015616 00000100:00100000:0.0:1788969972.106484:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 267 00000100:00100000:0.0:1788969972.106494:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:5598:x1875870732015616:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788969972.106512:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969972.106533:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b3d51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e89d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969972.106560:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b3d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e89d expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969972.106570:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b3d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e89d expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969972.106578:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5a00, rc 0) 00000100:00100000:0.0:1788969972.106644:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732015616:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 150us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969972.106651:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 267 00000100:00100000:3.0:1788969972.116313:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969972.116436:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732015744 00000100:00100000:1.0:1788969972.116446:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732015744 00000100:00100000:1.0:1788969972.116504:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 268 00000100:00100000:1.0:1788969972.116514:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732015744:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788969972.117176:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732015744:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 661us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969972.117185:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 268 00000100:00100000:0.0:1788969972.129079:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969972.130182:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732015872 00000100:00100000:3.0:1788969972.130194:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732015872 00000100:00100000:3.0:1788969972.130294:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 269 00000100:00100000:3.0:1788969972.130305:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732015872:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788969972.130516:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:5598:x1875870732015872:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 213us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969972.130525:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 269 00000100:00100000:0.0:1788969972.142192:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969972.142286:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732016000 00000100:00100000:1.0:1788969972.142298:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732016000 00000100:00100000:1.0:1788969972.142373:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 270 00000100:00100000:1.0:1788969972.142386:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:9952:x1875870732016000:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788969972.142647:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:9952:x1875870732016000:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 264us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969972.142668:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 270 00000100:00100000:2.0:1788969972.147898:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969972.148094:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732016128 00000100:00100000:3.0:1788969972.148104:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732016128 00000100:00100000:3.0:1788969972.148152:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 271 00000100:00100000:3.0:1788969972.148161:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:9952:x1875870732016128:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788969972.148408:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:9952:x1875870732016128:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 247us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969972.148417:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 271 00010000:00010000:0.0:1788969972.805402:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788969973.061612:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788969973.189879:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969973.189902:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741484928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788969973.189987:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969973.190150:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741484928 00000100:00100000:3.0:1788969973.190159:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741484928 00000100:00100000:3.0:1788969973.190240:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788969973.190250:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741484928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788969973.190286:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969973.190366:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741484928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969973.190373:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788969973.190439:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788969973.190555:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cede00 x1875870741484928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788969973.190580:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741484928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969973.819702:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969973.819743:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969973.819779:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969973.819887:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969973.819935:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732016512 00000100:00100000:2.0:1788969973.819948:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732016512 00000100:00100000:2.0:1788969973.820016:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:2.0:1788969973.820027:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732016512:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969973.820107:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732016512:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969973.820115:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00080000:2.0:1788969973.820150:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788969973.820574:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732016384 00000100:00100000:0.0:1788969973.820580:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732016384 00000100:00100000:0.0:1788969973.820624:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732016640 00000100:00100000:0.0:1788969973.820627:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732016640 00000100:00100000:0.0:1788969973.820662:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:0.0:1788969973.820671:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732016384:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969973.820714:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732016384:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 44us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969973.820720:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:0.0:1788969973.820734:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:0.0:1788969973.820741:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732016640:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969973.820764:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732016640:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 24us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969973.820769:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00080000:2.0:1788969973.821025:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969973.828021:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732016256 00000100:00100000:1.0:1788969973.828037:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732016256 00000100:00100000:1.0:1788969973.828109:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 272 00000100:00100000:1.0:1788969973.828120:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732016256:12345-192.168.202.9@tcp:400:kworker.0 00010000:00010000:1.0:1788969973.831538:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969973.831892:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732016256:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 3765us (12102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969973.831905:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 272 00000100:00100000:2.0:1788969974.212995:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741485440:0@lo:400:kworker.0 00000100:00100000:2.0:1788969974.213079:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969974.213149:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788969974.213156:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741485312:0@lo:400:kworker.0 00000100:00100000:2.0:1788969974.213181:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969974.213214:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741485440 00000100:00100000:2.0:1788969974.213221:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741485440 00000100:00100000:2.0:1788969974.213267:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788969974.213276:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741485440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969974.213343:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741485440:12345-0@lo:400:kworker.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969974.213350:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788969974.213391:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977865087840 x1875870741485440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969974.213593:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741485440:0@lo:400:kworker.0 00000100:00100000:2.0:1788969974.213631:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741485312 00000100:00100000:2.0:1788969974.213669:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741485312 00000100:00100000:2.0:1788969974.213705:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788969974.213711:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741485312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969974.213749:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741485312:12345-0@lo:400:kworker.0 Request processed in 38us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969974.213754:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1788969974.213771:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969974.213813:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741485312:0@lo:400:kworker.0 00000100:00100000:2.0:1788969974.214008:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788969974.214017:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741485824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969974.214056:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969974.214163:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741485824 00000100:00100000:3.0:1788969974.214168:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741485824 00000100:00100000:3.0:1788969974.214210:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788969974.214218:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741485824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788969974.214244:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969974.214419:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741485824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969974.214426:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788969974.214457:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788969974.214462:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97787857c3c0, transno 4294967300 00000100:00100000:3.0:1788969974.214477:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741485824:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788969974.214958:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788969974.215246:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741485184:0@lo:400:kworker.0 00000100:00100000:0.0:1788969974.215372:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969974.215455:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865085a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741485696:0@lo:400:kworker.0 00000100:00100000:0.0:1788969974.215480:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969974.215511:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788969974.215517:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865086d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741485056:0@lo:400:kworker.0 00000100:00100000:0.0:1788969974.215544:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969974.215570:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865086580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741485568:0@lo:400:kworker.0 00000100:00100000:0.0:1788969974.215590:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969974.215710:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741485056 00000100:00100000:1.0:1788969974.215717:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741485056 00000100:00100000:1.0:1788969974.215755:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788969974.215763:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741485056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969974.215826:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741485056:12345-0@lo:400:kworker.0 Request processed in 64us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969974.215832:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788969974.215875:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865086d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741485056:0@lo:400:kworker.0 00000100:00100000:2.0:1788969974.215939:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741485184 00000100:00100000:2.0:1788969974.215944:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741485184 00000100:00100000:2.0:1788969974.215976:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741485568 00000100:00100000:2.0:1788969974.215980:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741485568 00000100:00100000:2.0:1788969974.216006:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788969974.216012:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741485184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969974.216060:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741485184:12345-0@lo:400:kworker.0 Request processed in 48us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969974.216066:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788969974.216079:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788969974.216085:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741485568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969974.216111:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741485568:12345-0@lo:400:kworker.0 Request processed in 27us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969974.216129:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788969974.216262:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969974.217522:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865086580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741485568:0@lo:400:kworker.0 00000100:00100000:1.0:1788969974.217537:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741485184:0@lo:400:kworker.0 00000100:00100000:3.0:1788969974.217724:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741485696 00000100:00100000:3.0:1788969974.217732:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741485696 00000100:00100000:3.0:1788969974.217783:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788969974.217814:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741485696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969974.217882:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741485696:12345-0@lo:400:kworker.0 Request processed in 92us (2401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969974.217889:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788969974.218479:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865085a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741485696:0@lo:400:kworker.0 00010000:00010000:0.0:1788969974.853138:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969975.878060:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969976.901126:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969977.925245:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969978.315633:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741485952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969978.315727:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969978.315923:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741485952 00000100:00100000:0.0:1788969978.315932:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741485952 00000100:00100000:0.0:1788969978.316003:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788969978.316014:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865087840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741485952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788969978.316057:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788969978.316110:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865087840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741485952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969978.316119:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788969978.316166:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852ced680 x1875870741485952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969978.316189:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741485952:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788969978.317274:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788969978.937729:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969978.937843:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732016768 00000100:00100000:2.0:1788969978.937855:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732016768 00000100:00100000:2.0:1788969978.937912:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 274 00000100:00100000:2.0:1788969978.937922:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732016768:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969978.938015:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732016768:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969978.938022:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 274 00000100:00100000:3.0:1788969978.938388:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969978.938532:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732016896 00000100:00100000:2.0:1788969978.938536:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732016896 00000100:00100000:2.0:1788969978.938587:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:2.0:1788969978.938607:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732016896:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969978.938656:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732016896:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 50us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969978.938662:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00080000:0.0:1788969978.938869:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969978.940024:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969978.940054:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969978.940151:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732017152 00000100:00100000:1.0:1788969978.940201:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732017152 00000100:00100000:1.0:1788969978.940248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 104 00000100:00100000:1.0:1788969978.940254:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732017152:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969978.940332:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732017152:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 77us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969978.940339:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 104 00000100:00080000:0.0:1788969978.940884:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969978.942213:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732017024 00000100:00100000:2.0:1788969978.942225:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732017024 00000100:00100000:2.0:1788969978.942311:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:2.0:1788969978.942321:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732017024:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969978.942391:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732017024:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 71us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969978.942416:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00080000:0.0:1788969978.942626:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788969978.949087:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969979.333511:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741486080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788969979.333583:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969979.335866:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741486336:0@lo:400:kworker.0 00000100:00100000:1.0:1788969979.335905:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741486208:0@lo:400:kworker.0 00000100:00100000:0.0:1788969979.335934:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969979.335950:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969979.335972:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969979.335980:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741486464:0@lo:400:kworker.0 00000100:00100000:1.0:1788969979.335990:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741486720:0@lo:400:kworker.0 00000100:00100000:0.0:1788969979.336005:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969979.336025:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969979.336046:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741486336 00000100:00100000:1.0:1788969979.336051:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788969979.336055:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741486336 00000100:00100000:1.0:1788969979.336060:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741486592:0@lo:400:kworker.0 00000100:00100000:1.0:1788969979.336091:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969979.336101:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741486464 00000100:00100000:0.0:1788969979.336105:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741486464 00000100:00100000:1.0:1788969979.336130:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741486208 00000100:00100000:0.0:1788969979.336132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741486720 00000100:00100000:1.0:1788969979.336135:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741486208 00000100:00100000:0.0:1788969979.336137:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741486720 00000100:00100000:0.0:1788969979.336171:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788969979.336184:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788969979.336184:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741486336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969979.336196:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741486208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969979.336245:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741486336:12345-0@lo:400:kworker.0 Request processed in 66us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969979.336252:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788969979.336258:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741486208:12345-0@lo:400:kworker.0 Request processed in 62us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969979.336265:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788969979.336273:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788969979.336283:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741486464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969979.336297:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741486592 00000100:00100000:1.0:1788969979.336302:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741486592 00000100:00100000:0.0:1788969979.336314:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741486464:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969979.336321:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788969979.336330:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788969979.336338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788969979.336342:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741486592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969979.336350:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741486720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788969979.336383:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741486592:12345-0@lo:400:kworker.0 Request processed in 44us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969979.336390:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741486720:12345-0@lo:400:kworker.0 Request processed in 42us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969979.336398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788969979.336408:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788969979.336422:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788969979.336457:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787893b0c0 x1875870741486592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788969995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969979.336459:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741486464:0@lo:400:kworker.0 00000100:00100000:0.0:1788969979.336471:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741486336:0@lo:400:kworker.0 00000100:00100000:1.0:1788969979.336487:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741486592:0@lo:400:kworker.0 00000100:00100000:1.0:1788969979.336501:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741486208:0@lo:400:kworker.0 00000100:00100000:1.0:1788969979.336512:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741486720:0@lo:400:kworker.0 00000100:00100000:3.0:1788969979.339503:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741486080 00000100:00100000:3.0:1788969979.339519:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741486080 00000100:00100000:3.0:1788969979.339609:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788969979.339635:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741486080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788969979.339672:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788969979.339695:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788969979.339763:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741486080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (6180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969979.339771:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788969979.339848:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741486080:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788969979.973076:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969980.997955:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969982.021306:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969983.045922:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788969983.303223:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788969983.429198:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788969983.429223:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741486848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788969983.429297:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969983.430582:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741486848 00000100:00100000:3.0:1788969983.430594:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741486848 00000100:00100000:3.0:1788969983.430687:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788969983.430697:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741486848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788969983.430735:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969983.430844:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741486848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969983.430852:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788969983.430951:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cede00 x1875870741486848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788969999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969983.430971:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741486848:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788969983.431110:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788969984.069821:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969984.069873:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969984.069962:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732017408 00000100:00100000:0.0:1788969984.069976:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732017408 00000100:00100000:0.0:1788969984.070074:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 108 00000100:00100000:0.0:1788969984.070105:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732017408:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969984.070185:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732017408:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969984.070192:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 108 00010000:00010000:1.0:1788969984.070640:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788969984.070684:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969984.070896:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732017280 00000100:00100000:3.0:1788969984.070903:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732017280 00000100:00100000:3.0:1788969984.070949:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 276 00000100:00100000:3.0:1788969984.070958:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732017280:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969984.071013:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732017280:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 56us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969984.071019:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 276 00000100:00100000:2.0:1788969984.078102:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969984.078880:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732017536 00000100:00100000:3.0:1788969984.078894:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732017536 00000100:00100000:3.0:1788969984.078981:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:3.0:1788969984.078994:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2352:x1875870732017536:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:3.0:1788969984.079026:0:6678:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3c8d 00000100:00080000:3.0:1788969984.079035:0:6678:0:(import.c:65:import_set_state_nolock()) ffff97787f946800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788969984.079102:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788969984.079379:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+2:2352:x1875870732017536:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 388us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969984.079387:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00010000:00010000:1.0:1788969984.079580:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788969984.079635:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788969984.083105:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969984.088103:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732017664 00000100:00100000:1.0:1788969984.088120:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732017664 00000100:00100000:1.0:1788969984.088225:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:1.0:1788969984.088236:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878938f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732017664:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969984.089162:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878938f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732017664:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 922us (6064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969984.089172:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00080000:2.0:1788969984.089251:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969984.456326:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969984.456348:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741486976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788969984.456415:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969984.456718:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741486976 00000100:00100000:3.0:1788969984.456727:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741486976 00000100:00100000:3.0:1788969984.456786:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788969984.456823:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878939680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741486976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788969984.456856:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969984.456898:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878939680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741486976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969984.456905:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788969984.457114:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865086580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741487232:0@lo:400:kworker.0 00000100:00100000:2.0:1788969984.457146:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969984.457164:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788969984.457168:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741487104:0@lo:400:kworker.0 00000100:00100000:2.0:1788969984.457192:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969984.457210:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741487616:0@lo:400:kworker.0 00000100:00100000:2.0:1788969984.457227:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969984.457245:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741487104 00000100:00100000:2.0:1788969984.457248:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741487104 00000100:00100000:2.0:1788969984.457270:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788969984.457275:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741487104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969984.457303:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741487104:12345-0@lo:400:kworker.0 Request processed in 28us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969984.457309:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788969984.457358:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741487104:0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.457424:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741487232 00000100:00100000:0.0:1788969984.457428:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741487232 00000100:00100000:0.0:1788969984.457618:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741487616 00000100:00100000:0.0:1788969984.457623:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741487616 00000100:00100000:0.0:1788969984.457653:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788969984.457660:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741487232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.457699:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741487232:12345-0@lo:400:kworker.0 Request processed in 40us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969984.457705:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788969984.457717:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788969984.457722:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741487616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.457745:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741487616:12345-0@lo:400:kworker.0 Request processed in 24us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969984.457750:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788969984.457767:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788969984.457772:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788969984.457811:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741487616:0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.457822:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865086580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741487232:0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.457846:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865086d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741487360:0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.457868:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969984.457892:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741486976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788969984.457905:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969984.457909:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741487488:0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.457927:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969984.458021:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741487488 00000100:00100000:0.0:1788969984.458024:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741487488 00000100:00100000:0.0:1788969984.458047:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788969984.458052:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741487488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.458083:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741487488:12345-0@lo:400:kworker.0 Request processed in 30us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969984.458088:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788969984.458106:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741487360 00000100:00100000:0.0:1788969984.458109:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741487360 00000100:00100000:0.0:1788969984.458132:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788969984.458138:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741487360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.458164:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741487360:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969984.458169:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788969984.458183:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788969984.458202:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977865087480 x1875870741487488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969984.458213:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741487488:0@lo:400:kworker.0 00000100:00100000:0.0:1788969984.458222:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865086d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741487360:0@lo:400:kworker.0 00000001:00100000:2.0:1788969984.523012:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:2.0:1788969984.523023:0:7615:0:(genops.c:885:class_export_put()) final put ffff97787f945800/c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:3.0:1788969984.523100:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f945800/c7778032-abf5-4f7d-b43e-a87bfd7b090c for lustre-OST0001 00000020:00000080:3.0:1788969984.523153:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f946800 for lustre-OST0001 00010000:00010000:1.0:1788969985.093005:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969986.118355:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969987.142913:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969988.166603:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969988.549611:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788969988.553291:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741487744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969988.553583:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969988.553781:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741487744 00000100:00100000:1.0:1788969988.555450:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741487744 00000100:00100000:1.0:1788969988.555585:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788969988.555597:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865086d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741487744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788969988.555655:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969988.555760:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865086d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741487744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969988.555768:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788969988.556041:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977852cede00 x1875870741487744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788969988.556067:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977852cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741487744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788969988.557043:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788969989.178925:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969989.178983:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969989.179018:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969989.179132:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732017792 00000100:00100000:1.0:1788969989.179146:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732017792 00000100:00100000:1.0:1788969989.179223:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 278 00000100:00100000:1.0:1788969989.179239:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732017792:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969989.179326:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732017792:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 92us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969989.179334:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 278 00000100:00100000:2.0:1788969989.179424:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732017920 00000100:00100000:2.0:1788969989.179429:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732017920 00000100:00100000:2.0:1788969989.179484:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732018048 00000100:00100000:2.0:1788969989.179488:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732018048 00000100:00100000:2.0:1788969989.179535:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:2.0:1788969989.179543:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732017920:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969989.179580:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732017920:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 39us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969989.179587:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:2.0:1788969989.179600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:2.0:1788969989.179606:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732018048:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969989.179630:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732018048:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 24us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969989.179635:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00080000:1.0:1788969989.179868:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788969989.189938:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969989.573824:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f4821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741487872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788969989.573927:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969989.574124:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741487872 00000100:00100000:1.0:1788969989.574135:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741487872 00000100:00100000:1.0:1788969989.574204:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788969989.574215:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741487872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788969989.574257:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969989.574313:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741487872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969989.574321:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788969989.574345:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788969989.574976:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f4803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741488000:0@lo:400:kworker.0 00000100:00100000:2.0:1788969989.575024:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969989.575078:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741488512:0@lo:400:kworker.0 00000100:00100000:2.0:1788969989.575107:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969989.575130:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788969989.575136:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741488384:0@lo:400:kworker.0 00000100:00100000:2.0:1788969989.575160:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969989.575190:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741488512 00000100:00100000:2.0:1788969989.575195:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741488512 00000100:00100000:2.0:1788969989.575242:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788969989.575250:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741488512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969989.575295:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741488512:12345-0@lo:400:kworker.0 Request processed in 46us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969989.575302:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788969989.575355:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741488512:0@lo:400:kworker.0 00000100:00100000:3.0:1788969989.575517:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741488000 00000100:00100000:3.0:1788969989.575522:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741488000 00000100:00100000:3.0:1788969989.575565:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788969989.575572:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741488000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969989.575616:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741488000:12345-0@lo:400:kworker.0 Request processed in 44us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969989.575622:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788969989.575654:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741488384 00000100:00100000:3.0:1788969989.575657:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741488384 00000100:00100000:3.0:1788969989.575684:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788969989.575699:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865086580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741488384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969989.575732:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865086580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741488384:12345-0@lo:400:kworker.0 Request processed in 34us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969989.575738:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788969989.575766:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778615ce940 x1875870741488384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788969989.575778:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741488384:0@lo:400:kworker.0 00000100:00100000:3.0:1788969989.575820:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f4803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741488000:0@lo:400:kworker.0 00000100:00100000:0.0:1788969989.575980:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741488256:0@lo:400:kworker.0 00000100:00100000:0.0:1788969989.576015:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969989.576041:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788969989.576047:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741488128:0@lo:400:kworker.0 00000100:00100000:0.0:1788969989.576069:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969989.576099:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741488256 00000100:00100000:0.0:1788969989.576103:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741488256 00000100:00100000:0.0:1788969989.576130:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741488128 00000100:00100000:0.0:1788969989.576133:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741488128 00000100:00100000:0.0:1788969989.576150:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788969989.576156:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741488256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969989.576191:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741488256:12345-0@lo:400:kworker.0 Request processed in 35us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969989.576197:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788969989.576209:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788969989.576214:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878939e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741488128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969989.576240:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878939e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741488128:12345-0@lo:400:kworker.0 Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969989.576245:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788969989.576275:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741488128:0@lo:400:kworker.0 00000100:00100000:0.0:1788969989.576285:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741488256:0@lo:400:kworker.0 00000100:00100000:0.0:1788969989.576323:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f4821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741487872:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788969989.576578:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788969990.213339:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969991.238450:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969992.268417:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788969993.287008:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788969993.541429:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788969993.671027:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788969993.671050:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778615cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741488640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788969993.671119:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969993.671635:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741488640 00000100:00100000:3.0:1788969993.671644:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741488640 00000100:00100000:3.0:1788969993.671714:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788969993.671724:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878938780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741488640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788969993.671760:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788969993.671842:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878938780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741488640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969993.671849:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788969993.671913:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788969993.671987:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778615cf480 x1875870741488640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969993.672024:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778615cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741488640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788969994.301508:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969994.301559:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969994.301602:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969994.301606:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732018176 00000100:00100000:2.0:1788969994.301617:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732018176 00000100:00100000:2.0:1788969994.301674:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 280 00000100:00100000:2.0:1788969994.301687:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732018176:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969994.301745:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732018432 00000100:00100000:0.0:1788969994.301751:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732018432 00000100:00100000:2.0:1788969994.301772:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732018176:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969994.301787:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 280 00000100:00100000:0.0:1788969994.301839:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732018304 00000100:00100000:0.0:1788969994.301843:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732018304 00000100:00100000:0.0:1788969994.301873:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:0.0:1788969994.301881:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732018432:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788969994.301902:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:2.0:1788969994.301923:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732018304:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969994.301935:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732018432:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 54us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969994.301943:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:2.0:1788969994.301957:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732018304:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 46us (354us total) trans 0 rc 0/0 00000100:00080000:0.0:1788969994.301986:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788969994.301998:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 119 00010000:00010000:1.0:1788969994.315194:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969994.693101:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741489152:0@lo:400:kworker.0 00000100:00100000:2.0:1788969994.693173:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969994.693221:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788969994.693227:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741488768:0@lo:400:kworker.0 00000100:00100000:2.0:1788969994.693252:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969994.693274:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741489280:0@lo:400:kworker.0 00000100:00100000:2.0:1788969994.693308:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969994.693334:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741488768 00000100:00100000:2.0:1788969994.693340:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741488768 00000100:00100000:2.0:1788969994.693376:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788969994.693384:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741488768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969994.693425:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741488768:12345-0@lo:400:kworker.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969994.693432:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788969994.693484:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741488768:0@lo:400:kworker.0 00000100:00100000:3.0:1788969994.693664:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741489024:0@lo:400:kworker.0 00000100:00100000:3.0:1788969994.693694:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969994.693722:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788969994.693726:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741488896:0@lo:400:kworker.0 00000100:00100000:3.0:1788969994.693744:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969994.693759:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741489408:0@lo:400:kworker.0 00000100:00100000:3.0:1788969994.693786:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969994.693830:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741489280 00000100:00100000:3.0:1788969994.693834:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741489280 00000100:00100000:3.0:1788969994.693867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741489024 00000100:00100000:3.0:1788969994.693869:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741489024 00000100:00100000:3.0:1788969994.693880:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741488896 00000100:00100000:3.0:1788969994.693882:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741488896 00000100:00100000:3.0:1788969994.693893:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788969994.693899:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741489280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969994.693932:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741489280:12345-0@lo:400:kworker.0 Request processed in 33us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969994.693937:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788969994.693948:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788969994.693953:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741489024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969994.693976:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741489024:12345-0@lo:400:kworker.0 Request processed in 22us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969994.693981:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788969994.693990:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788969994.693995:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741488896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969994.694029:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741488896:12345-0@lo:400:kworker.0 Request processed in 34us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969994.694034:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788969994.694060:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741488896:0@lo:400:kworker.0 00000100:00100000:3.0:1788969994.694068:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741489024:0@lo:400:kworker.0 00000100:00100000:3.0:1788969994.694086:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741489280:0@lo:400:kworker.0 00000100:00100000:0.0:1788969994.694753:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741489152 00000100:00100000:0.0:1788969994.694760:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741489152 00000100:00100000:0.0:1788969994.694804:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741489408 00000100:00100000:0.0:1788969994.694807:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741489408 00000100:00100000:0.0:1788969994.694828:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788969994.694843:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741489152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969994.694889:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741489152:12345-0@lo:400:kworker.0 Request processed in 55us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969994.694895:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788969994.694907:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788969994.694913:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741489408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788969994.694958:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741489408:12345-0@lo:400:kworker.0 Request processed in 46us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969994.694964:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788969994.694985:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788969994.694989:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788969994.695022:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741489408:0@lo:400:kworker.0 00010000:00080000:0.0:1788969994.695046:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787857f480 x1875870741489152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788969994.695056:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741489152:0@lo:400:kworker.0 00000100:00100000:0.0:1788969994.701504:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788969994.701529:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741489536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788969994.701606:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969994.701703:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741489536 00000100:00100000:1.0:1788969994.701711:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741489536 00000100:00100000:1.0:1788969994.701753:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788969994.701761:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741489536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788969994.704511:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788969994.704610:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741489536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2844us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969994.704620:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788969994.704838:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741489536:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788969994.910301:0:11822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:06:33 (1788969993) 00010000:00010000:1.0:1788969995.336119:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969996.336907:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969996.337232:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732018560 00000100:00100000:3.0:1788969996.337242:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732018560 00000100:00100000:3.0:1788969996.337387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:3.0:1788969996.337400:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:10221:x1875870732018560:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788969996.337424:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969996.337464:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8a4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969996.337533:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969996.337547:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969996.337560:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969996.337595:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788969996.337600:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788969996.337639:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969996.337664:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b3d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8a4 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969996.337685:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8a4 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969996.337694:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c000) 00010000:00010000:3.0:1788969996.337714:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788969996.337718:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8e00, rc 0) 00000100:00100000:3.0:1788969996.337785:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:10221:x1875870732018560:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 388us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969996.337838:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00080000:0.0:1788969996.337898:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969996.346778:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969996.346915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732018688 00000100:00100000:2.0:1788969996.346924:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732018688 00000100:00100000:2.0:1788969996.346996:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:2.0:1788969996.347006:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f481680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:10222:x1875870732018688:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788969996.347026:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788969996.347047:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b3d66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8ab expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.347601:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.347617:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.347629:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.347644:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.347651:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.347658:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.347906:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c200/0x5d0de860b05b3d7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.347915:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c200/0x5d0de860b05b3d7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.347922:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c200/0x5d0de860b05b3d7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788969996.348009:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788969996.348013:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788969996.348035:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c200/0x5d0de860b05b3d7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348056:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348062:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348069:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348075:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44da00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788969996.348079:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348087:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348100:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c000) 00010000:00010000:2.0:1788969996.348103:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788969996.348107:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348114:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3d6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348126:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348544:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348552:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348564:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44cc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788969996.348567:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348575:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348583:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff977843e0b400) 00010000:00010000:2.0:1788969996.348586:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788969996.348589:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348594:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3d74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348632:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b3d66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ab expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348647:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c200/0x5d0de860b05b3d7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ab expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969996.348654:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff977843e0b300) 00010000:00010000:2.0:1788969996.348656:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788969996.348658:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c200, rc 0) 00000100:00100000:2.0:1788969996.348856:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f481680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:10222:x1875870732018688:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1850us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969996.348863:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00010000:00010000:1.0:1788969996.360464:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969996.363851:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969996.363965:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732018944 00000100:00100000:1.0:1788969996.363976:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732018944 00000100:00100000:1.0:1788969996.364043:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:1.0:1788969996.364053:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:10222:x1875870732018944:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788969996.364074:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969996.364097:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b3d82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364172:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364186:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364197:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364265:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364273:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364280:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364678:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b3d97 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364688:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b3d97 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364695:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b3d97 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788969996.364706:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788969996.364886:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364895:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364902:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364909:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969996.364913:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364930:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364943:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff977843e0b300) 00010000:00010000:1.0:1788969996.364946:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969996.364952:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364959:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3d89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364972:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364979:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364984:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364990:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969996.364993:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.364998:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.365004:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9778519ab100) 00010000:00010000:1.0:1788969996.365007:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969996.365009:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.365025:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3d90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.365494:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b3d82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8b2 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.365514:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b3d97 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8b2 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969996.365522:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:1.0:1788969996.365524:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969996.365526:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92c00, rc 0) 00000100:00100000:1.0:1788969996.365624:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:10222:x1875870732018944:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1571us (1783us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788969996.365633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:1.0:1788969996.370889:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969996.371057:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732019072 00000100:00100000:2.0:1788969996.371068:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732019072 00000100:00100000:2.0:1788969996.371133:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:2.0:1788969996.371144:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:10222:x1875870732019072:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788969996.371257:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:10222:x1875870732019072:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 Request processed in 115us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969996.371264:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00000040:00080000:2.0:1788969996.614813:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788969997.381131:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788969998.389693:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969998.389777:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732019200 00000100:00100000:1.0:1788969998.389813:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732019200 00000100:00100000:1.0:1788969998.389875:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:1.0:1788969998.389885:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:10264:x1875870732019200:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788969998.389906:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969998.389928:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3da5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8b9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.389989:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390009:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390021:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390034:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390041:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390048:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390223:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390230:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390237:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390243:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969998.390247:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390255:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390266:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c000) 00010000:00010000:1.0:1788969998.390273:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969998.390279:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390285:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3dac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390296:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390302:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390308:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390313:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969998.390316:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390335:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390343:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9778519ab100) 00010000:00010000:1.0:1788969998.390346:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969998.390348:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390353:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3db3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390383:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3da5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8b9 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390403:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c000) 00010000:00010000:1.0:1788969998.390406:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969998.390419:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b3da5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8b9 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.390429:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93a00, rc 0) 00000100:00100000:1.0:1788969998.390488:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:10264:x1875870732019200:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 604us (804us total) trans 0 rc 301/301 00000100:00100000:1.0:1788969998.390495:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00080000:0.0:1788969998.390647:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969998.397497:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969998.397736:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732019456 00000100:00100000:1.0:1788969998.397748:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732019456 00000100:00100000:1.0:1788969998.397868:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:1.0:1788969998.397880:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:10264:x1875870732019456:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:1.0:1788969998.397946:0:7061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969998.397982:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b3d5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8a4 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.398005:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c000) 00010000:00010000:1.0:1788969998.398016:0:7061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788969998.398234:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.398247:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.398258:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.398282:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.398290:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.398297:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788969998.399185:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788969998.399198:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.399206:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.399213:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.399220:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969998.399224:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.399232:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.399242:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9778519abc00) 00010000:00010000:1.0:1788969998.399245:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969998.399248:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.399266:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3dba lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788969998.399288:0:7061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd131a1f reply state 00000000f296c4c7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969998.399296:0:7061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788969998.399419:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:10264:x1875870732019456:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 1528us (1922us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788969998.399428:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00010000:00010000:0.0:1788969998.401837:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.401856:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.401864:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.401870:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969998.401881:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.401889:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.401907:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9778519ab600) 00010000:00010000:0.0:1788969998.401922:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788969998.401927:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.401934:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3dc1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.405113:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788969998.495550:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969998.495898:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732019584 00000100:00100000:3.0:1788969998.495909:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732019584 00000100:00100000:3.0:1788969998.495966:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:3.0:1788969998.495978:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:10272:x1875870732019584:12345-192.168.202.9@tcp:101:lctl.0 00010000:00010000:3.0:1788969998.496011:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969998.496032:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3dc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.496094:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b3dcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.496108:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b3dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.496119:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b3dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969998.496153:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788969998.496156:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788969998.496193:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b3dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.496218:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3dc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8c0 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.496244:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b3dcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8c0 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.496253:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:3.0:1788969998.496256:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788969998.496259:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd200, rc 0) 00000100:00100000:3.0:1788969998.496324:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:10272:x1875870732019584:12345-192.168.202.9@tcp:101:lctl.0 Request processed in 350us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969998.496331:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:1.0:1788969998.552196:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.552466:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732019712 00000100:00100000:0.0:1788969998.552477:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732019712 00000100:00100000:0.0:1788969998.552538:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:0.0:1788969998.552549:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:10278:x1875870732019712:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788969998.552573:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969998.552597:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b3dd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.552667:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.552681:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.552693:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.552740:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.552748:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.552755:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.552900:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484c00/0x5d0de860b05b3deb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.552909:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484c00/0x5d0de860b05b3deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.552917:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484c00/0x5d0de860b05b3deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788969998.552945:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788969998.552948:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788969998.552988:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484c00/0x5d0de860b05b3deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553000:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553006:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553012:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553028:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969998.553032:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553039:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553051:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:0.0:1788969998.553055:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788969998.553060:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553065:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b3ddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553079:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553085:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553090:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553095:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969998.553097:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553102:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553119:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff977849672200) 00010000:00010000:0.0:1788969998.553122:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788969998.553125:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553131:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b3de4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553167:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b3dd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8c7 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553186:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484c00/0x5d0de860b05b3deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8c7 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.553193:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:0.0:1788969998.553195:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788969998.553197:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484c00, rc 0) 00000100:00100000:0.0:1788969998.554520:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:10278:x1875870732019712:12345-192.168.202.9@tcp:101:bash.0 Request processed in 1965us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969998.554531:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:1.0:1788969998.556444:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969998.556561:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732019968 00000100:00100000:3.0:1788969998.556570:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732019968 00000100:00100000:3.0:1788969998.556668:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:3.0:1788969998.556679:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:10278:x1875870732019968:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1788969998.556700:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969998.556720:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3df2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.556879:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.556902:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.557082:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.557155:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.557180:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.557188:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788969998.557729:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788969998.558334:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558347:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558356:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558388:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558397:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558404:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558422:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dce00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969998.558427:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558434:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558459:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788969998.558462:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969998.558467:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558474:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3df9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788969998.558489:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067c206c2 reply state 00000000acc180e3 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969998.558497:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788969998.558529:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3df2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ce expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558542:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ce expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.558550:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3cd00) 00010000:00010000:3.0:1788969998.558552:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788969998.558555:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc000, rc 0) 00000100:00100000:3.0:1788969998.558662:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10278:x1875870732019968:12345-192.168.202.9@tcp:101:bash.0 Request processed in 1984us (2226us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788969998.558671:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00010000:00010000:2.0:1788969998.561283:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969998.561300:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969998.561308:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969998.561314:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788969998.561319:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969998.561328:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969998.561344:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977858b3cb00) 00010000:00010000:2.0:1788969998.561347:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788969998.561351:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969998.561358:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b3e00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969998.563459:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.563606:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732020096 00000100:00100000:0.0:1788969998.563616:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732020096 00000100:00100000:0.0:1788969998.563669:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:0.0:1788969998.563678:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875870732020096:12345-192.168.202.9@tcp:8:bash.0 00010000:00080000:0.0:1788969998.563710:0:8534:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:0.0:1788969998.563744:0:8534:0:(genops.c:1384:class_connect()) connect: client c7778032-abf5-4f7d-b43e-a87bfd7b090c, cookie 0x5d0de860b05b3e15 00002000:00100000:0.0:1788969998.563758:0:8534:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c7778032-abf5-4f7d-b43e-a87bfd7b090c/ffff97784eb70000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788969998.563834:0:8534:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1788969998.564096:0:8534:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788969998.564128:0:8534:0:(import.c:65:import_set_state_nolock()) ffff97784eb77000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788969998.564200:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2352:x1875870732020096:12345-192.168.202.9@tcp:8:bash.0 Request processed in 521us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969998.564209:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:3.0:1788969998.566945:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.567106:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732020224 00000100:00100000:0.0:1788969998.567116:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732020224 00000100:00100000:0.0:1788969998.567195:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:0.0:1788969998.567206:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:0:x1875870732020224:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788969998.567224:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969998.567247:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8d5 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788969998.567273:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788969998.567292:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1788969998.567297:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788969998.567307:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8d5 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.567329:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8d5 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.567342:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485a00, rc 0) 00000100:00100000:0.0:1788969998.567422:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:0:x1875870732020224:12345-192.168.202.9@tcp:101:bash.0 Request processed in 201us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969998.567449:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00080000:2.0:1788969998.567562:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788969998.572528:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.572734:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732020352 00000100:00100000:0.0:1788969998.572746:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732020352 00000100:00100000:0.0:1788969998.572845:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:0.0:1788969998.572855:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:10278:x1875870732020352:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788969998.572873:0:8534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969998.572891:0:8534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8dc expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.572931:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8d5 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.572941:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788969998.572945:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788969998.572951:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 8 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.573146:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8d5 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.573162:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8d5 expref: 8 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969998.573176:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8534:1875870741489664:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788969998.573309:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f410f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788969998.576009:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.576131:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8534:1875870741489664:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788969998.576165:0:8534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 8 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.576187:0:8534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484200, rc 0) 00000100:00100000:0.0:1788969998.576245:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:10278:x1875870732020352:12345-192.168.202.9@tcp:101:bash.0 Request processed in 3392us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969998.576253:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:1.0:1788969998.576445:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732020480 00000100:00100000:1.0:1788969998.576452:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732020480 00010000:00010000:1.0:1788969998.576482:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8d5 expref: 8 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969998.576512:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:1.0:1788969998.576520:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732020480:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788969998.576531:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969998.576552:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8d5 expref: 8 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.576584:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8d5 expref: 8 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.576608:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c50ad1/0x5d0de860b05b3e1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8d5 expref: 8 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.576623:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788969998.576628:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788969998.576636:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 7 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.576646:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 7 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.576674:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 7 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969998.576687:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878948f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1875870741489792:192.168.202.9@tcp:105: 00000100:00100000:1.0:1788969998.576744:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784634a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788969998.580591:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969998.580685:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732020736 00000100:00100000:2.0:1788969998.580693:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732020736 00000100:00100000:2.0:1788969998.580744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:2.0:1788969998.580753:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:10278:x1875870732020736:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:2.0:1788969998.581307:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10278:x1875870732020736:12345-192.168.202.9@tcp:35:bash.0 Request processed in 553us (724us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788969998.581316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1788969998.581944:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878948f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1875870741489792:192.168.202.9@tcp:105: 00010000:00010000:1.0:1788969998.581965:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969998.582090:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732020480:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 5569us (6087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969998.582098:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:3.0:1788969998.647494:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969998.647604:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732020992 00000100:00100000:1.0:1788969998.647616:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732020992 00000100:00100000:1.0:1788969998.647681:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:1.0:1788969998.647692:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10288:x1875870732020992:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788969998.647717:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969998.647739:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3e2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8e3 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788969998.647883:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788969998.648032:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3e2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8e3 expref: 16 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.648047:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:1.0:1788969998.648050:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788969998.648056:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3e2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8e3 expref: 16 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.648069:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92e00, rc 0) 00000100:00100000:1.0:1788969998.648134:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:10288:x1875870732020992:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 443us (649us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788969998.648141:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:3.0:1788969998.650926:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969998.651031:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732021248 00000100:00100000:2.0:1788969998.651040:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732021248 00000100:00100000:2.0:1788969998.651082:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1788969998.651091:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:10288:x1875870732021248:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788969998.651301:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:10288:x1875870732021248:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 210us (392us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788969998.651308:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:3.0:1788969998.714350:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.714524:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732021376 00000100:00100000:0.0:1788969998.714536:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732021376 00000100:00100000:0.0:1788969998.714608:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:0.0:1788969998.714618:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:10294:x1875870732021376:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788969998.714644:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969998.714666:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8ea expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.714732:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.714745:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.714768:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788969998.714845:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788969998.714849:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788969998.714871:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.714924:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ea expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.714945:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ea expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.714954:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:0.0:1788969998.714956:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788969998.714961:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484600, rc 0) 00000100:00100000:0.0:1788969998.715138:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:10294:x1875870732021376:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 521us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969998.715145:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:3.0:1788969998.719886:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969998.720062:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732021632 00000100:00100000:1.0:1788969998.720072:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732021632 00000100:00100000:1.0:1788969998.720129:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:1.0:1788969998.720139:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:10294:x1875870732021632:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788969998.720160:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969998.720183:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3e46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8f1 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.720300:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.720314:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.720325:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788969998.720336:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788969998.720464:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3e46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8f1 expref: 20 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.720482:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8f1 expref: 19 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.720490:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3cd00) 00010000:00010000:1.0:1788969998.720494:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788969998.720497:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92600, rc 0) 00000100:00100000:1.0:1788969998.720676:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10294:x1875870732021632:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 537us (798us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788969998.720684:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:1.0:1788969998.725135:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969998.725169:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.725256:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732021888 00000100:00100000:0.0:1788969998.725267:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732021888 00000100:00100000:0.0:1788969998.725332:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:0.0:1788969998.725343:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878948f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10294:x1875870732021888:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788969998.725369:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969998.725390:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8f8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.725502:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.725517:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.725528:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788969998.725556:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788969998.725676:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8f8 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.725694:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8f8 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.725703:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3cd00) 00010000:00010000:0.0:1788969998.725706:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788969998.725710:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485400, rc 0) 00000100:00100000:0.0:1788969998.725984:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878948f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10294:x1875870732021888:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 642us (859us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788969998.725993:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:3.0:1788969998.726608:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732022016 00000100:00100000:3.0:1788969998.726616:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732022016 00000100:00100000:3.0:1788969998.726668:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:3.0:1788969998.726678:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878949680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:2355:x1875870732022016:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788969998.726690:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969998.726707:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8f1 expref: 21 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.726721:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3cd00) 00010000:00010000:3.0:1788969998.726725:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788969998.726757:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878949680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:2355:x1875870732022016:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 81us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969998.726763:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:2.0:1788969998.734111:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.734211:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732022144 00000100:00100000:0.0:1788969998.734231:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732022144 00000100:00100000:0.0:1788969998.734300:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:0.0:1788969998.734311:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732022144:12345-192.168.202.9@tcp:1:lfs.0 00010000:00010000:0.0:1788969998.734361:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.734385:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 7 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.734394:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788969998.734399:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788969998.734500:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.734554:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 7 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.734570:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 7 pid: 8534 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969998.734585:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1875870741489920:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788969998.734684:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f410f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788969998.737780:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969998.737892:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732022272 00000100:00100000:3.0:1788969998.737903:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732022272 00002000:00100000:3.0:1788969998.738084:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff977877fca940 x1875870732022272/t0(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:529/0 lens 504/0 e 0 to 0 dl 1788970009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788969998.738095:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff977877fca940 with x1875870732022272 ext(0->12) 00010000:00010000:3.0:1788969998.738104:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 8 pid: 8534 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.738121:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 8 pid: 8534 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788969998.738148:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff977877fca940 00000100:00100000:3.0:1788969998.738172:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1788969998.738181:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732022272:12345-192.168.202.9@tcp:4:lfs.0 00000100:00100000:0.0:1788969998.739001:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1875870741489920:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788969998.739027:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788969998.769941:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000100:00100000:3.0:1788969998.770903:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2353:x1875870732022272:12345-192.168.202.9@tcp:4:lfs.0 Request processed in 32716us (33124us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788969998.770924:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00002000:00100000:3.0:1788969998.770938:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff977877fca940 x1875870732022272/t4294967299(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:529/0 lens 504/448 e 0 to 0 dl 1788970009 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788969998.770950:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff977877fca940 with x1875870732022272 ext(0->12) 00010000:00010000:3.0:1788969998.770960:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 9 pid: 8534 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.770988:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 9 pid: 8534 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788969998.770996:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff977877fca940 00000100:00100000:3.0:1788969998.775082:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969998.775320:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732022400 00000100:00100000:1.0:1788969998.775333:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732022400 00010000:00010000:1.0:1788969998.775375:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 9 pid: 8534 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969998.775476:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:1.0:1788969998.775487:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a31e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2355:x1875870732022400:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788969998.775514:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788969998.775534:0:11142:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788969998.775538:0:11142:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788969999 00002000:00010000:1.0:1788969998.775540:0:11142:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788969999 00002000:00010000:1.0:1788969998.775543:0:11142:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788969999 00010000:00010000:1.0:1788969998.775549:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 9 pid: 8534 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.775564:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 9 pid: 8534 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.775588:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b3e23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8dc expref: 9 pid: 8534 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.775602:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788969998.775606:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788969998.775611:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.775621:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.775656:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969998.775720:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a31e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2355:x1875870732022400:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 234us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969998.775728:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00010000:00010000:0.0:1788969998.775805:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.775814:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.775840:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.775849:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.775869:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.775876:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788969998.775880:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.775889:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.775901:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.775921:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b3e70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969998.775980:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732022144:12345-192.168.202.9@tcp:1:lfs.0 Request processed in 41661us (42210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969998.775988:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:2.0:1788969998.778870:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969998.779157:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732022656 00000100:00100000:3.0:1788969998.779167:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732022656 00000100:00100000:0.0:1788969998.779303:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:0.0:1788969998.779320:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:10294:x1875870732022656:12345-192.168.202.9@tcp:35:lfs.0 00000004:00010000:0.0:1788969998.779424:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8f8 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788969998.779709:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788969998.779785:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788969998.780659:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788969998.780724:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.780741:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ce expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.780751:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.780841:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ce expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.780858:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ce expref: 24 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969998.780872:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875870741490048:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788969998.781600:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f410000 going to sleep for 11 seconds 00000100:00100000:2.0:1788969998.786257:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.786483:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875870741490048:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788969998.786509:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969998.786635:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732022784 00000100:00100000:3.0:1788969998.786643:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732022784 00010000:00010000:3.0:1788969998.786684:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ce expref: 25 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969998.786843:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:3.0:1788969998.786871:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:2354:x1875870732022784:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788969998.786888:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788969998.786895:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ce expref: 25 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.786965:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ce expref: 25 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.787044:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3e07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ce expref: 25 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.787060:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3cd00) 00010000:00010000:3.0:1788969998.787065:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.787075:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.787082:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969998.787101:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788969998.787153:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:2354:x1875870732022784:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 285us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969998.787161:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00010000:00010000:0.0:1788969998.788077:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.788089:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788969998.788228:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788969998.788402:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788969998.788536:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741490176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788969998.788600:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969998.788644:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788969998.788949:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741490176 00000100:00100000:2.0:1788969998.788956:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741490176 00000100:00100000:2.0:1788969998.789010:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788969998.789018:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875870741490176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788969998.789082:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875870741490176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 64us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969998.789099:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788969998.789496:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788969998.789544:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741490176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788969998.790570:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788969998.790647:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741490304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788969998.790694:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969998.790719:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f410000 going to sleep for 11 seconds 00000100:00100000:1.0:1788969998.791440:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741490304 00000100:00100000:1.0:1788969998.791448:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741490304 00000100:00100000:1.0:1788969998.791491:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788969998.791500:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875870741490304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788969998.791722:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875870741490304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 223us (1027us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788969998.791731:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788969998.792051:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741490304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788969998.792116:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788969998.792160:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.792170:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.792178:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.792183:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969998.792188:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.792196:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.792395:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3cd00) 00010000:00010000:0.0:1788969998.792399:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788969998.792413:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.792419:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788969998.792611:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1788969998.792861:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788969998.792878:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741490432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788969998.792936:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788969998.793185:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741490432 00000100:00100000:0.0:1788969998.793191:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741490432 00000100:00100000:0.0:1788969998.793317:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788969998.793327:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741490432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788969998.793346:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788969998.793391:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741490432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969998.793398:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788969998.793653:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741490432:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788969998.794050:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788969998.794065:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310757274866ns, next at 311757271997ns, rc = 0 00000001:00080000:0.0:1788969998.794078:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788969998.794131:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3cd00) 00010000:00010000:0.0:1788969998.794135:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788969998.794143:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8f8 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969998.794360:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10294:x1875870732022656:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 15046us (15498us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788969998.794389:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000020:00080000:0.0:1788969998.794394:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788969998.796640:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969998.796717:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732022912 00000100:00100000:1.0:1788969998.796726:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732022912 00000100:00100000:1.0:1788969998.796817:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:1.0:1788969998.796827:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10294:x1875870732022912:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788969998.796850:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969998.796871:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3e7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e8ff expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.796937:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3e7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ff expref: 28 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.796951:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3e7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ff expref: 28 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.796970:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788969998.796973:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788969998.796986:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93200, rc 0) 00000100:00100000:1.0:1788969998.797040:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:10294:x1875870732022912:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 215us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969998.797062:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:2.0:1788969998.800577:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.800651:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732023168 00000100:00100000:0.0:1788969998.800661:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732023168 00000100:00100000:0.0:1788969998.800712:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:0.0:1788969998.800721:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:10294:x1875870732023168:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1788969998.800989:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:10294:x1875870732023168:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 267us (419us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788969998.800996:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1788969998.877622:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969998.877734:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732023424 00000100:00100000:1.0:1788969998.877747:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732023424 00000100:00100000:1.0:1788969998.877837:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:1.0:1788969998.877844:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:10304:x1875870732023424:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788969998.877867:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969998.877887:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3e85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e906 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788969998.878092:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788969998.878207:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3e85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e906 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.878219:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:1.0:1788969998.878222:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788969998.878227:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3e85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e906 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.878241:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92600, rc 0) 00000100:00100000:1.0:1788969998.878300:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10304:x1875870732023424:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 456us (690us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788969998.878305:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:3.0:1788969998.881487:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.881595:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732023552 00000100:00100000:0.0:1788969998.881606:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732023552 00000100:00100000:0.0:1788969998.881663:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:0.0:1788969998.881673:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10304:x1875870732023552:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:0.0:1788969998.881747:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.881775:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.881786:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.881837:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.881844:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.881850:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.881979:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.881988:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.881995:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788969998.882037:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882050:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882056:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882064:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882069:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969998.882073:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882080:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882091:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:0.0:1788969998.882094:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788969998.882099:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882112:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3e93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882126:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882131:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882138:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882142:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969998.882146:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882151:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882158:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977849672200) 00010000:00010000:0.0:1788969998.882161:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788969998.882163:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882169:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3e9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882182:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882188:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882200:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882205:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969998.882208:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882214:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882222:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:0.0:1788969998.882224:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788969998.882227:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.882232:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969998.882303:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10304:x1875870732023552:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 630us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969998.882310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:2.0:1788969998.885736:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.885864:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732023808 00000100:00100000:0.0:1788969998.885874:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732023808 00000100:00100000:0.0:1788969998.885938:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1788969998.885948:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10304:x1875870732023808:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1788969998.886186:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:10304:x1875870732023808:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 238us (460us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788969998.886193:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788969998.916555:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969998.916649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732024064 00000100:00100000:1.0:1788969998.916659:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732024064 00000100:00100000:1.0:1788969998.916720:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:1.0:1788969998.916731:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:10308:x1875870732024064:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788969998.916786:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969998.916852:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3ea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e90d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.916952:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.916968:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917270:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917288:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917296:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917304:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917434:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917443:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917450:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788969998.917460:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788969998.917564:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917572:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917579:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917585:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969998.917590:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917598:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917610:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:1.0:1788969998.917613:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969998.917617:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917624:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3eaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917637:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917643:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917650:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917664:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788969998.917667:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917674:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917682:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9778519abc00) 00010000:00010000:1.0:1788969998.917685:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788969998.917688:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917694:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917738:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e90d expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917752:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e90d expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969998.917772:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788969998.917774:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788969998.917777:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92200, rc 0) 00000100:00100000:1.0:1788969998.917879:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:10308:x1875870732024064:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1149us (1333us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788969998.917887:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:3.0:1788969998.920920:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.921090:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732024192 00000100:00100000:0.0:1788969998.921101:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732024192 00000100:00100000:0.0:1788969998.921157:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:0.0:1788969998.921167:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:10308:x1875870732024192:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:0.0:1788969998.921238:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.921255:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.921266:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.921292:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.921298:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.921305:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.921311:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969998.921315:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.921322:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.921333:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:0.0:1788969998.921336:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788969998.921340:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969998.921361:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969998.921505:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:10308:x1875870732024192:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 339us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969998.921514:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:3.0:1788969998.927586:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969998.927679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732024448 00000100:00100000:0.0:1788969998.927692:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732024448 00000100:00100000:0.0:1788969998.927770:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:0.0:1788969998.927781:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:10308:x1875870732024448:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1788969998.928075:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:10308:x1875870732024448:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 296us (498us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788969998.928082:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1788969999.160592:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969999.160958:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732024704 00000100:00100000:0.0:1788969999.160969:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732024704 00000100:00100000:0.0:1788969999.161155:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1788969999.161166:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:10339:x1875870732024704:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:0.0:1788969999.161191:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969999.161212:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e914 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.161312:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.161327:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.161358:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788969999.161370:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788969999.161524:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e914 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.161545:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e914 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.161554:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:0.0:1788969999.161557:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788969999.161561:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484e00, rc 0) 00000100:00100000:0.0:1788969999.161679:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:10339:x1875870732024704:12345-192.168.202.9@tcp:101:cat.0 Request processed in 515us (1096us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788969999.161686:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:3.0:1788969999.166595:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969999.166654:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969999.166711:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732024960 00000100:00100000:0.0:1788969999.166721:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732024960 00000100:00100000:0.0:1788969999.166805:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:0.0:1788969999.166816:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:10339:x1875870732024960:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:1.0:1788969999.167358:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732025088 00000100:00100000:1.0:1788969999.167372:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732025088 00000100:00100000:1.0:1788969999.167421:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:1.0:1788969999.167430:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778600e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:2353:x1875870732025088:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788969999.167443:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969999.167470:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b3ed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e914 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.167488:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788969999.167493:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788969999.167723:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:10339:x1875870732024960:12345-192.168.202.9@tcp:35:cat.0 Request processed in 907us (1136us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788969999.167732:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:1.0:1788969999.167802:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778600e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:2353:x1875870732025088:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 360us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969999.167809:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:3.0:1788969999.238512:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969999.238633:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732025344 00000100:00100000:0.0:1788969999.238644:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732025344 00000100:00100000:0.0:1788969999.238712:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:0.0:1788969999.238723:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:10345:x1875870732025344:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:0.0:1788969999.238777:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788969999.238780:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788969999.238850:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ea expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.238870:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:0.0:1788969999.238875:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788969999.238888:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ee7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e91b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.239187:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.239203:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e90d expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.239211:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.239245:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e90d expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.239260:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e90d expref: 36 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969999.239274:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741490560:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788969999.239358:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f410f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788969999.243607:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969999.243767:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741490560:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788969999.243845:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969999.246161:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732025472 00000100:00100000:1.0:1788969999.246175:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732025472 00010000:00010000:1.0:1788969999.246224:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e90d expref: 37 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969999.246333:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:1.0:1788969999.246343:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:2353:x1875870732025472:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788969999.246357:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969999.246364:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e90d expref: 37 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.246377:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e90d expref: 37 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.246398:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3ebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e90d expref: 37 pid: 5834 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.246441:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788969999.246446:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.246456:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.246465:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.246611:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969999.246678:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:2353:x1875870732025472:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 335us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969999.246685:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00010000:00010000:0.0:1788969999.248486:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.248501:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788969999.248522:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788969999.248703:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b3ee7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e91b expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.248723:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e91b expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.248731:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:0.0:1788969999.248734:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788969999.248737:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485400, rc 0) 00000100:00100000:0.0:1788969999.248825:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:10345:x1875870732025344:12345-192.168.202.9@tcp:101:dd.0 Request processed in 10104us (10323us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788969999.248834:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:2.0:1788969999.251954:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969999.252216:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732025728 00000100:00100000:0.0:1788969999.252227:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732025728 00000100:00100000:0.0:1788969999.252321:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:0.0:1788969999.252332:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:10345:x1875870732025728:12345-192.168.202.9@tcp:36:dd.0 00010000:00010000:0.0:1788969999.252620:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.252658:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.252670:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788969999.252742:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788969999.252783:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024bc65c6 reply state 00000000f2beaf58 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969999.252830:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788969999.252925:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+39:10345:x1875870732025728:12345-192.168.202.9@tcp:36:dd.0 Request processed in 593us (979us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788969999.252933:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00000020:00080000:0.0:1788969999.252938:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788969999.254612:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.254629:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.254637:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.254644:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969999.254649:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.254657:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.254674:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:3.0:1788969999.254677:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969999.254683:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.254690:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b3efc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788969999.367305:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:0.0:1788969999.367333:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788969999.367359:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97787f4103c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788969999.367364:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97784c25d400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97787f410c00 00000020:00080000:0.0:1788969999.367367:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97784c25d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff977880d0f800 00000020:00080000:3.0:1788969999.372140:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788969999.372280:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788969999.373280:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741490688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788969999.373357:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969999.373454:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741490688 00000100:00100000:2.0:1788969999.373462:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741490688 00000100:00100000:2.0:1788969999.373510:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788969999.373518:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741490688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788969999.373542:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788969999.373578:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa1840f, atime: 0x6aa1840f, ctime: 0x6aa1840f, blocks: 0x1 00010000:00010000:2.0:1788969999.373587:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969999.373604:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=311s v=(0 0) 00010000:00010000:2.0:1788969999.373609:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788969999.373630:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969999.373648:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969999.375324:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969999.375343:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788969999.375416:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788969999.376122:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3284:x1875870741490688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2601us (2762us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788969999.376133:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1788969999.377857:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff977877fc92c0/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788969999.377872:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741490688:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788969999.383047:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788969999.383062:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.383078:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788969999.383083:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.383118:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.383140:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.383148:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000093a4692/0x5d0de860b05b3f03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.383181:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969999.383183:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788969999.383184:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969999.422426:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969999.422479:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969999.422513:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969999.422630:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732026112 00000100:00100000:0.0:1788969999.422641:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732026112 00000100:00100000:0.0:1788969999.422727:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00100000:0.0:1788969999.422738:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732026112:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788969999.422842:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732026112:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 106us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788969999.422850:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00080000:2.0:1788969999.422983:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788969999.424136:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732025856 00000100:00100000:3.0:1788969999.424189:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732025856 00000100:00100000:3.0:1788969999.424244:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 282 00000100:00100000:3.0:1788969999.424254:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732025856:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788969999.424310:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732025856:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 57us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969999.424316:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 282 00000100:00100000:1.0:1788969999.425590:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732025984 00000100:00100000:1.0:1788969999.425601:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732025984 00000100:00100000:1.0:1788969999.425664:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:1.0:1788969999.425673:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732025984:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788969999.425744:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732025984:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 71us (3351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969999.425751:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00010000:00010000:1.0:1788969999.429175:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788969999.585364:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969999.585449:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732026240 00000100:00100000:1.0:1788969999.585458:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732026240 00000100:00100000:1.0:1788969999.585522:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:1.0:1788969999.585532:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:10359:x1875870732026240:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:1.0:1788969999.585554:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788969999.585586:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3f0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e922 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.585646:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.585660:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.585671:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.585684:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.585692:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.585698:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.586031:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.586043:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e91b expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.586052:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.586089:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e91b expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.586117:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e91b expref: 12 pid: 5833 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969999.586131:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878949680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741490816:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788969999.586241:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788969999.590316:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969999.590444:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732026496 00000100:00100000:0.0:1788969999.590455:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732026496 00000100:00100000:0.0:1788969999.590521:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:0.0:1788969999.590531:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:5595:x1875870732026496:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788969999.591052:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:5595:x1875870732026496:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 521us (746us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788969999.591076:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1788969999.593044:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878949680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741490816:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788969999.593075:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788969999.599184:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788969999.599341:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732026624 00000100:00100000:1.0:1788969999.599351:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732026624 00010000:00010000:1.0:1788969999.599393:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e91b expref: 14 pid: 5833 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788969999.599453:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:1.0:1788969999.599463:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:2354:x1875870732026624:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788969999.599480:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788969999.599487:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e91b expref: 14 pid: 5833 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.599501:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e91b expref: 14 pid: 5833 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.599522:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b3eee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e91b expref: 14 pid: 5833 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.599551:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788969999.599557:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.599566:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.599573:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788969999.599603:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788969999.599666:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2354:x1875870732026624:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 205us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788969999.599674:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00010000:00010000:3.0:1788969999.601308:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601323:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969999.601374:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788969999.601379:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788969999.601461:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601479:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601489:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601496:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601503:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601510:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969999.601514:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601538:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601553:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788969999.601556:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969999.601560:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601565:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b3f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601580:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601586:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601591:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601596:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969999.601598:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601603:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601610:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9778519abb00) 00010000:00010000:3.0:1788969999.601613:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969999.601615:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601630:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b3f18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601673:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b3f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e922 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601688:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e922 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.601695:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:3.0:1788969999.601697:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788969999.601699:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92e00, rc 0) 00000100:00100000:3.0:1788969999.601856:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:10359:x1875870732026240:12345-192.168.202.9@tcp:101:stat.0 Request processed in 16324us (16500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969999.601864:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:2.0:1788969999.676080:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788969999.676183:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732026880 00000100:00100000:0.0:1788969999.676193:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732026880 00000100:00100000:0.0:1788969999.676260:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:0.0:1788969999.676271:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845375680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:10365:x1875870732026880:12345-192.168.202.9@tcp:36:truncate.0 00010000:00010000:0.0:1788969999.676328:0:7061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788969999.676353:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b3f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e922 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.676373:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:0.0:1788969999.676378:0:7061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788969999.676590:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.676604:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.676614:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788969999.676663:0:7061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788969999.676688:0:7061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adbd91b3 reply state 000000000947374e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788969999.676696:0:7061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788969999.676886:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845375680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10365:x1875870732026880:12345-192.168.202.9@tcp:36:truncate.0 Request processed in 615us (814us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788969999.676893:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 54 00000020:00080000:0.0:1788969999.676917:0:7061:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788969999.681197:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.681226:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.681235:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.681241:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788969999.681245:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.681254:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.681271:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:0.0:1788969999.681274:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788969999.681278:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788969999.681285:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b3f26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788969999.813103:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741491328:0@lo:400:kworker.0 00000100:00100000:3.0:1788969999.813163:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969999.813232:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788969999.813238:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741491200:0@lo:400:kworker.0 00000100:00100000:3.0:1788969999.813263:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788969999.813293:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741491328 00000100:00100000:3.0:1788969999.813300:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741491328 00000100:00100000:3.0:1788969999.813340:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741491200 00000100:00100000:3.0:1788969999.813341:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741491200 00000100:00100000:3.0:1788969999.813354:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788969999.813359:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741491328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969999.813416:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741491328:12345-0@lo:400:kworker.0 Request processed in 56us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969999.813438:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788969999.813455:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788969999.813459:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741491200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969999.813479:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741491200:12345-0@lo:400:kworker.0 Request processed in 21us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969999.813483:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788969999.813509:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741491200:0@lo:400:kworker.0 00000100:00100000:3.0:1788969999.813520:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741491328:0@lo:400:kworker.0 00000100:00080000:2.0:1788969999.813685:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788969999.813979:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741491072:0@lo:400:kworker.0 00000100:00100000:1.0:1788969999.814009:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969999.814040:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788969999.814046:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741490944:0@lo:400:kworker.0 00000100:00100000:1.0:1788969999.814070:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788969999.814094:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741491456:0@lo:400:kworker.0 00000100:00100000:1.0:1788969999.814109:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969999.814195:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741490944 00000100:00100000:2.0:1788969999.814198:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741490944 00000100:00100000:2.0:1788969999.814244:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788969999.814260:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741490944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969999.814293:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741490944:12345-0@lo:400:kworker.0 Request processed in 36us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969999.814298:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788969999.814323:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741490944:0@lo:400:kworker.0 00000100:00100000:2.0:1788969999.814336:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741491456 00000100:00100000:2.0:1788969999.814338:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741491456 00000100:00100000:2.0:1788969999.814358:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788969999.814361:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878948b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741491456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788969999.814386:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878948b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741491456:12345-0@lo:400:kworker.0 Request processed in 23us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969999.814392:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788969999.814420:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788969999.814435:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741491456:0@lo:400:kworker.0 00000100:00100000:2.0:1788969999.814680:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788969999.814687:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977845374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741491584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788969999.814706:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788969999.814726:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741491584 00000100:00100000:2.0:1788969999.814728:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741491584 00000100:00100000:2.0:1788969999.814745:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788969999.814749:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778453743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741491584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788969999.814773:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788969999.814827:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778453743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741491584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788969999.814834:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788969999.814865:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977845374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741491584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788969999.815118:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741491072 00000100:00100000:3.0:1788969999.815122:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741491072 00000100:00100000:3.0:1788969999.815147:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788969999.815152:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878949680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741491072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788969999.815185:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878949680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741491072:12345-0@lo:400:kworker.0 Request processed in 33us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969999.815188:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788969999.815705:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741491072:0@lo:400:kworker.0 00000100:00100000:2.0:1788969999.828743:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969999.828876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732027008 00000100:00100000:3.0:1788969999.828888:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732027008 00000100:00100000:3.0:1788969999.828951:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1788969999.829061:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:10379:x1875870732027008:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:3.0:1788969999.829089:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969999.829110:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e929 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.829178:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.829666:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.829682:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.829701:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.829709:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.829716:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.830914:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.830928:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.830938:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969999.831380:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788969999.831387:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788969999.831422:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831435:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831458:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831465:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831472:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831478:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969999.831483:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831489:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831500:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788969999.831502:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969999.831506:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831510:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3f34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831522:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831525:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831529:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831537:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788969999.831538:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831542:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831546:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977858b3c400) 00010000:00010000:3.0:1788969999.831548:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788969999.831549:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831553:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831582:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e929 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831591:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e929 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.831596:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:3.0:1788969999.831598:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788969999.831599:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dce00, rc 0) 00000100:00100000:3.0:1788969999.831673:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10379:x1875870732027008:12345-192.168.202.9@tcp:101:stat.0 Request processed in 2712us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788969999.831681:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:2.0:1788969999.932436:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788969999.932516:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732027264 00000100:00100000:3.0:1788969999.932538:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732027264 00000100:00100000:3.0:1788969999.932632:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:3.0:1788969999.932644:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778453752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10389:x1875870732027264:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788969999.932667:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788969999.932689:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e930 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788969999.932787:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788969999.932946:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e930 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.932962:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:3.0:1788969999.932965:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788969999.932971:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e930 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788969999.933042:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc600, rc 0) 00000100:00100000:3.0:1788969999.933093:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778453752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:10389:x1875870732027264:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 453us (703us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788969999.933098:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:0.0:1788969999.938686:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788969999.938970:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732027520 00000100:00100000:2.0:1788969999.938980:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732027520 00000100:00100000:2.0:1788969999.939110:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:2.0:1788969999.939120:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:10389:x1875870732027520:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788969999.939595:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:10389:x1875870732027520:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 473us (915us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788969999.939605:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:2.0:1788970000.038871:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.039143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732027776 00000100:00100000:0.0:1788970000.039154:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732027776 00000100:00080000:2.0:1788970000.039235:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970000.039248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:0.0:1788970000.039261:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:10395:x1875870732027776:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970000.039287:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970000.039308:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b3f57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e937 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.039469:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.039485:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e929 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.039495:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.039532:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e929 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.039546:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e929 expref: 17 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970000.039559:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741491712:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970000.039662:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f410a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970000.042103:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.042406:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732027904 00000100:00100000:3.0:1788970000.042416:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732027904 00010000:00010000:3.0:1788970000.042460:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e929 expref: 18 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970000.042508:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:3.0:1788970000.042518:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:2353:x1875870732027904:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970000.042565:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970000.042574:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e929 expref: 18 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.042588:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e929 expref: 18 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.042612:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:3.0:1788970000.042618:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.042628:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.042636:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.042668:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970000.042739:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:2353:x1875870732027904:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 222us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970000.042747:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00010000:00010000:2.0:1788970000.047143:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b3f42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e929 expref: 17 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970000.047173:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741491712:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970000.047200:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.047212:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.047219:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970000.047240:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788970000.048264:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b3f57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e937 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.048327:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e937 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.048336:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:2.0:1788970000.048340:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788970000.048343:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484000, rc 0) 00000100:00100000:2.0:1788970000.048428:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:10395:x1875870732027776:12345-192.168.202.9@tcp:101:bash.0 Request processed in 9170us (9566us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788970000.048438:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:0.0:1788970000.053997:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.054438:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732028160 00000100:00100000:3.0:1788970000.054449:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732028160 00000100:00100000:3.0:1788970000.054510:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:3.0:1788970000.054521:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:10395:x1875870732028160:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:3.0:1788970000.055034:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.055052:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.055081:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970000.055133:0:7061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788970000.055159:0:7061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009abd1a76 reply state 00000000c8d10887 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970000.055168:0:7061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970000.055469:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:10395:x1875870732028160:12345-192.168.202.9@tcp:36:bash.0 Request processed in 948us (1480us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788970000.055477:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00000020:00080000:3.0:1788970000.055482:0:7061:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788970000.061592:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.064925:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732028288 00000100:00100000:0.0:1788970000.064941:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732028288 00000100:00100000:0.0:1788970000.065033:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:0.0:1788970000.065044:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:10395:x1875870732028288:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970000.065069:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970000.065091:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b3f73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e93e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.065194:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.065210:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e937 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.065218:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.065224:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.065242:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.065268:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e937 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.065282:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e937 expref: 21 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970000.065495:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dcb4780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741491840:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970000.068175:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f410480 going to sleep for 11 seconds 00010000:00010000:1.0:1788970000.070054:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.070072:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.070094:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.070101:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970000.070105:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.070113:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.070129:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788970000.070132:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970000.070135:0:3270:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.070144:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.070151:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3f6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970000.074272:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.074387:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dcb4780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741491840:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970000.074426:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970000.077175:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732028416 00000100:00100000:1.0:1788970000.077189:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732028416 00010000:00010000:1.0:1788970000.077239:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e937 expref: 21 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970000.077287:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:1.0:1788970000.077311:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:2353:x1875870732028416:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970000.077326:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970000.077348:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e937 expref: 21 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.077363:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e937 expref: 21 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.077385:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b3f5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e937 expref: 21 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.077414:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788970000.077420:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.077430:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.077438:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.077460:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970000.077514:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:2353:x1875870732028416:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 204us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970000.077521:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00010000:00010000:0.0:1788970000.078648:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.078680:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970000.078734:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788970000.078739:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970000.078760:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.078837:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b3f73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e93e expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.078856:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e93e expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.078864:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:0.0:1788970000.078867:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970000.078871:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485c00, rc 0) 00000100:00100000:0.0:1788970000.079227:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10395:x1875870732028288:12345-192.168.202.9@tcp:101:bash.0 Request processed in 14183us (17645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970000.079236:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:3.0:1788970000.082477:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970000.082515:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732028672 00000100:00100000:2.0:1788970000.082527:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732028672 00000100:00100000:2.0:1788970000.082602:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788970000.082613:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10395:x1875870732028672:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:2.0:1788970000.083157:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:10395:x1875870732028672:12345-192.168.202.9@tcp:35:bash.0 Request processed in 544us (689us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788970000.083166:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788970000.225007:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.225136:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732028928 00000100:00100000:3.0:1788970000.225148:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732028928 00000100:00100000:3.0:1788970000.225222:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:3.0:1788970000.225233:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:10405:x1875870732028928:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970000.225258:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970000.225283:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e945 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970000.225434:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788970000.225678:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e945 expref: 22 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.225693:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:3.0:1788970000.225702:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970000.225708:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3f81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e945 expref: 22 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.225725:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd400, rc 0) 00000100:00100000:3.0:1788970000.225852:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10405:x1875870732028928:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 558us (794us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788970000.225859:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:0.0:1788970000.230460:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970000.230563:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732029056 00000100:00100000:1.0:1788970000.230574:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732029056 00000100:00100000:1.0:1788970000.230634:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:1.0:1788970000.230645:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10405:x1875870732029056:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:1.0:1788970000.230720:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.230755:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.230780:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.230820:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.230828:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.230834:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231104:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231113:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231121:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970000.231162:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231173:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231180:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231197:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231203:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970000.231208:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231214:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231226:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:1.0:1788970000.231229:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970000.231234:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231240:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b3f8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231253:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231258:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231264:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231268:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970000.231271:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231285:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231292:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9778519abc00) 00010000:00010000:1.0:1788970000.231295:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970000.231298:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231304:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3f96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231317:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231323:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231328:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231332:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970000.231334:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231339:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231345:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788970000.231347:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970000.231350:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.231365:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b3f9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970000.231459:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10405:x1875870732029056:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 815us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970000.231467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:1.0:1788970000.239998:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970000.240132:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732029312 00000100:00100000:2.0:1788970000.240143:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732029312 00000100:00100000:2.0:1788970000.240208:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:2.0:1788970000.240217:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10405:x1875870732029312:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970000.240449:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:10405:x1875870732029312:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 232us (461us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788970000.240457:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:2.0:1788970000.307593:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.315554:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732029568 00000100:00100000:3.0:1788970000.315572:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732029568 00000100:00100000:3.0:1788970000.315658:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:3.0:1788970000.315669:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:10408:x1875870732029568:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970000.315696:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970000.316135:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3fa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e94c expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316222:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316237:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316248:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316263:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316270:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316297:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316650:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3fb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316660:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316667:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970000.316678:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788970000.316776:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316784:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316814:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316820:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970000.316824:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316832:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316843:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970000.316846:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970000.316858:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316864:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b3fab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316878:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316885:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316891:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316908:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970000.316911:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316917:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316925:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977858b3c400) 00010000:00010000:3.0:1788970000.316928:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970000.316931:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.316937:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b3fb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.317916:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3fa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e94c expref: 25 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.317969:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e94c expref: 24 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.317977:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:3.0:1788970000.317979:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970000.317982:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc600, rc 0) 00000100:00100000:3.0:1788970000.318129:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:10408:x1875870732029568:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 2462us (10548us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788970000.318138:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:0.0:1788970000.320511:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970000.320665:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732029696 00000100:00100000:1.0:1788970000.320675:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732029696 00000100:00100000:1.0:1788970000.320744:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:1.0:1788970000.320755:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:10408:x1875870732029696:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1788970000.320863:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.320880:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.320892:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.320933:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.320941:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.320948:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.320955:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970000.320976:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.321245:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.321260:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788970000.321263:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970000.321269:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.321275:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b3fc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970000.321357:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:10408:x1875870732029696:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 603us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970000.321365:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:1.0:1788970000.323372:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.323461:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732029824 00000100:00100000:3.0:1788970000.323470:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732029824 00000100:00100000:3.0:1788970000.323527:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1788970000.323538:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:2356:x1875870732029824:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970000.323553:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970000.323579:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3fb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e94c expref: 24 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.323600:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:3.0:1788970000.323604:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970000.323653:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:2356:x1875870732029824:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 118us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970000.323659:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:2.0:1788970000.328079:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.328175:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732030080 00000100:00100000:0.0:1788970000.328184:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732030080 00000100:00100000:0.0:1788970000.328250:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1788970000.328266:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:10408:x1875870732030080:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1788970000.328532:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:10408:x1875870732030080:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 273us (463us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788970000.328555:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00010000:00010000:0.0:1788970000.453920:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970000.508292:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.508435:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732030336 00000100:00100000:3.0:1788970000.508447:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732030336 00000100:00100000:3.0:1788970000.508510:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:3.0:1788970000.508537:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:10426:x1875870732030336:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:3.0:1788970000.508563:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970000.508611:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3fce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e953 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.508708:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3fd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.508724:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.508735:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970000.508746:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788970000.509029:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b3fce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e953 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.509050:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e953 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.509058:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:3.0:1788970000.509062:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788970000.509065:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd400, rc 0) 00000100:00100000:3.0:1788970000.509129:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10426:x1875870732030336:12345-192.168.202.9@tcp:101:cat.0 Request processed in 595us (847us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788970000.509137:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:1.0:1788970000.549927:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970000.550376:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732030464 00000100:00100000:2.0:1788970000.550414:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732030464 00000100:00100000:2.0:1788970000.550474:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:2.0:1788970000.550485:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10427:x1875870732030464:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970000.550510:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970000.550533:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3fe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e95a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.550599:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.550614:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.550626:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970000.550661:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788970000.550665:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970000.550680:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.550705:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3fe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e95a expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.550722:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e95a expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.550749:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:2.0:1788970000.550752:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970000.550756:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44da00, rc 0) 00000100:00100000:2.0:1788970000.550868:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10427:x1875870732030464:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 385us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970000.550876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:0.0:1788970000.555863:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970000.556715:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732030848 00000100:00100000:2.0:1788970000.556726:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732030848 00000100:00100000:2.0:1788970000.557111:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1788970000.557123:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10427:x1875870732030848:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970000.557426:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:10427:x1875870732030848:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 305us (1570us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788970000.557433:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1788970000.561122:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970000.561230:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732030976 00000100:00100000:1.0:1788970000.561240:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732030976 00000100:00100000:1.0:1788970000.561310:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1788970000.561321:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:10427:x1875870732030976:12345-192.168.202.9@tcp:103:lfs.0 00010000:00010000:1.0:1788970000.561337:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788970000.561361:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b3f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e93e expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.561383:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b3fd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e953 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.561443:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b3e7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ff expref: 26 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970000.561452:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9778519ab100) 00010000:00010000:1.0:1788970000.561463:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970000.561512:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:10427:x1875870732030976:12345-192.168.202.9@tcp:103:lfs.0 Request processed in 193us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970000.561520:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1788970000.569427:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.569519:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732031104 00000100:00100000:0.0:1788970000.569529:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732031104 00000100:00100000:0.0:1788970000.569591:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:0.0:1788970000.569600:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878949e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:10427:x1875870732031104:12345-192.168.202.9@tcp:58:lfs.0 00010000:00010000:0.0:1788970000.569719:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.569735:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.569746:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970000.570385:0:7061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970000.570568:0:7061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788970000.570633:0:7061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788970000.570749:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878949e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:10427:x1875870732031104:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 1147us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970000.570757:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:0.0:1788970000.602577:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970000.602674:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732031232 00000100:00100000:2.0:1788970000.602685:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732031232 00000100:00100000:2.0:1788970000.602747:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:2.0:1788970000.602756:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:10429:x1875870732031232:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970000.602777:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970000.602833:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3ff8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e961 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.602898:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.602912:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.602940:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.602968:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.602975:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.603142:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604121:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604133:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604141:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970000.604177:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788970000.604181:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970000.604200:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604212:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604220:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604238:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604245:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604251:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970000.604256:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604264:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604275:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:2.0:1788970000.604278:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970000.604284:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604290:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b3fff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604304:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604310:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604316:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604320:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44ce00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970000.604328:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604334:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604342:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977843e0b800) 00010000:00010000:2.0:1788970000.604345:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970000.604347:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604403:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b3ff8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e961 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604417:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e961 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.604425:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672200) 00010000:00010000:2.0:1788970000.604428:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970000.604430:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c600, rc 0) 00000100:00100000:2.0:1788970000.604506:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10429:x1875870732031232:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1750us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970000.604514:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 67 00000040:00080000:3.0:1788970000.709329:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970000.709339:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970000.709418:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788970000.709425:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970000.709576:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d41e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741491968:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788970000.709692:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e160c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970000.714125:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.714292:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d41e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741491968:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788970000.718095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732031360 00000100:00100000:0.0:1788970000.718112:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732031360 00000100:00100000:0.0:1788970000.718448:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:0.0:1788970000.718460:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878948780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10440:x1875870732031360:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788970000.718589:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878948780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10440:x1875870732031360:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 Request processed in 131us (4472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970000.718597:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:1.0:1788970000.723960:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.724690:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732031488 00000100:00100000:0.0:1788970000.724700:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732031488 00000100:00100000:0.0:1788970000.724873:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:0.0:1788970000.724883:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10440:x1875870732031488:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788970000.725125:0:7061:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788970000.725226:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10440:x1875870732031488:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 345us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970000.725234:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:3.0:1788970000.728828:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.728888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732031616 00000100:00100000:0.0:1788970000.728899:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732031616 00000100:00100000:0.0:1788970000.728968:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:0.0:1788970000.728978:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10440:x1875870732031616:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788970000.729063:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729080:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729091:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729139:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729147:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729351:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729380:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729401:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729408:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970000.729445:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788970000.729449:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970000.729464:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729475:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729481:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729489:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729495:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970000.729500:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729518:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729537:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:0.0:1788970000.729540:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970000.729545:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729551:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4014 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729564:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729569:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729574:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729579:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970000.729581:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729586:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729593:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff977849672000) 00010000:00010000:0.0:1788970000.729594:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970000.729597:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729602:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b401b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729636:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729642:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729648:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729652:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970000.729655:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729662:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729669:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672200) 00010000:00010000:0.0:1788970000.729671:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970000.729674:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.729679:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970000.734308:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10440:x1875870732031616:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 5319us (5511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970000.734326:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:0.0:1788970000.739586:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.739625:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732031872 00000100:00100000:0.0:1788970000.739635:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732031872 00000100:00100000:0.0:1788970000.739696:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:0.0:1788970000.739706:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10440:x1875870732031872:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970000.739724:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970000.739745:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4029 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e968 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.739864:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.739879:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.739891:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970000.739902:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788970000.740001:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.740009:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.740016:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.740021:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970000.740025:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.740032:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.740060:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672200) 00010000:00010000:0.0:1788970000.740064:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970000.740069:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.740076:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b4030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.740118:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4029 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e968 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.740129:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:0.0:1788970000.740131:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970000.740134:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4029 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e968 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.740147:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485200, rc 0) 00000100:00100000:0.0:1788970000.740206:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10440:x1875870732031872:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 502us (631us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788970000.740213:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:0.0:1788970000.748784:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970000.748872:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732032000 00000100:00100000:1.0:1788970000.748883:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732032000 00000100:00100000:1.0:1788970000.748942:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:1.0:1788970000.748953:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10440:x1875870732032000:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788970000.748998:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788970000.749110:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10440:x1875870732032000:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 159us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970000.749117:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:1.0:1788970000.754759:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.754858:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732032256 00000100:00100000:3.0:1788970000.754869:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732032256 00000100:00100000:3.0:1788970000.754938:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:3.0:1788970000.754949:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10440:x1875870732032256:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970000.754972:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970000.754976:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788970000.755001:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b3fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e95a expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.755018:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970000.755022:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970000.755036:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b403e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e96f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788970000.755662:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788970000.755918:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.755929:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.755937:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.755989:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b403e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e96f expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.756000:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e96f expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.756005:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3c400) 00010000:00010000:3.0:1788970000.756007:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970000.756009:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dde00, rc 0) 00000100:00100000:3.0:1788970000.756067:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:10440:x1875870732032256:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1121us (1317us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788970000.756075:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:1.0:1788970000.760706:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.760960:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732032512 00000100:00100000:3.0:1788970000.760971:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732032512 00000100:00100000:3.0:1788970000.761034:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:3.0:1788970000.761045:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:10440:x1875870732032512:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788970000.761100:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970000.761126:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e96f expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761142:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3c400) 00010000:00010000:3.0:1788970000.761153:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970000.761174:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761187:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761205:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761221:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761228:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761234:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761423:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761429:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761433:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761437:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970000.761441:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761446:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761452:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970000.761453:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970000.761456:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761464:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4053 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761472:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761475:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761479:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761482:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dce00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970000.761484:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761487:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761492:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7605663d (ffff977858b3c900) 00010000:00010000:3.0:1788970000.761493:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970000.761495:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.761498:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b405a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7605663d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970000.762614:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10440:x1875870732032512:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 1567us (1914us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788970000.762635:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:2.0:1788970000.765518:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.765609:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732032640 00000100:00100000:3.0:1788970000.765619:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732032640 00000100:00100000:3.0:1788970000.765672:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:3.0:1788970000.765682:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10440:x1875870732032640:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970000.765704:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970000.765729:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4061 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e976 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.765775:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.765878:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.765900:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.765999:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e976 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.766017:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e976 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.766025:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:3.0:1788970000.766027:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788970000.766031:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd400, rc 0) 00000100:00100000:3.0:1788970000.766089:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:10440:x1875870732032640:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 409us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970000.766096:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:1.0:1788970000.775353:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.775473:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732032896 00000100:00100000:0.0:1788970000.775485:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732032896 00000100:00100000:0.0:1788970000.775571:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:0.0:1788970000.775582:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:10440:x1875870732032896:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788970000.775666:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.775694:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.775718:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970000.776168:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788970000.776179:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312739388808ns, next at 313739386543ns, rc = 0 00000004:00010000:0.0:1788970000.776406:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2521544 reply state 00000000c7aadecb transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970000.776416:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970000.776585:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10440:x1875870732032896:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 998us (1497us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788970000.776594:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 75 00010000:00010000:3.0:1788970000.781011:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.781031:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.781039:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.781045:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970000.781050:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.781058:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.781072:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:3.0:1788970000.781075:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788970000.781079:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.781086:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b406f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970000.782571:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970000.783527:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732033024 00000100:00100000:2.0:1788970000.783540:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732033024 00000100:00100000:2.0:1788970000.783608:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:2.0:1788970000.783674:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:10440:x1875870732033024:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970000.783700:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970000.783720:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e97d expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.783785:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e97d expref: 30 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.783831:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e97d expref: 30 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.783851:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:2.0:1788970000.783854:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970000.783858:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d600, rc 0) 00000100:00100000:2.0:1788970000.783923:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10440:x1875870732033024:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 291us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970000.783930:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:1.0:1788970000.790736:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.792152:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732033152 00000100:00100000:3.0:1788970000.792168:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732033152 00000100:00100000:3.0:1788970000.792237:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:3.0:1788970000.792246:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875870732033152:12345-192.168.202.9@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788970000.792278:0:6678:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:3.0:1788970000.792308:0:6678:0:(genops.c:1384:class_connect()) connect: client c7778032-abf5-4f7d-b43e-a87bfd7b090c, cookie 0x5d0de860b05b407d 00002000:00100000:3.0:1788970000.792320:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c7778032-abf5-4f7d-b43e-a87bfd7b090c/ffff97787882a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788970000.792338:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1788970000.792592:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788970000.792628:0:6678:0:(import.c:65:import_set_state_nolock()) ffff97787882d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970000.792703:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2352:x1875870732033152:12345-192.168.202.9@tcp:8:lhsmtool_posix.0 Request processed in 457us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970000.792711:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:1.0:1788970000.796232:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.796439:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732033280 00000100:00100000:3.0:1788970000.796450:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732033280 00000100:00100000:3.0:1788970000.796524:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:3.0:1788970000.796535:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:0:x1875870732033280:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788970000.797030:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788970000.859442:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1788970000.859457:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000100:00100000:3.0:1788970000.859906:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:0:x1875870732033280:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 63366us (63679us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788970000.859916:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:3.0:1788970000.863560:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970000.863615:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732033536 00000100:00100000:2.0:1788970000.863625:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732033536 00000100:00100000:2.0:1788970000.863733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1788970000.863744:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10440:x1875870732033536:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788970000.864007:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:10440:x1875870732033536:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 264us (456us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788970000.864015:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:1.0:1788970000.865577:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.865664:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732033792 00000100:00100000:3.0:1788970000.865673:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732033792 00000100:00100000:3.0:1788970000.865728:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:3.0:1788970000.865738:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852cee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:10440:x1875870732033792:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970000.865884:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852cee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:10440:x1875870732033792:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 148us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970000.865903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:1.0:1788970000.870462:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.870599:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732033920 00000100:00100000:0.0:1788970000.870610:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732033920 00000100:00100000:0.0:1788970000.870703:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:0.0:1788970000.870713:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:10440:x1875870732033920:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970000.870734:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970000.870756:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e984 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.870906:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b408b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.870922:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b408b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.870944:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b408b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970000.870981:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970000.870999:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b408b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.871025:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e984 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.871045:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b408b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e984 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970000.871053:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:0.0:1788970000.871056:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788970000.871060:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485e00, rc 0) 00000100:00100000:0.0:1788970000.871114:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:10440:x1875870732033920:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 402us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970000.871121:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:1.0:1788970000.876321:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.876422:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732034048 00000100:00100000:3.0:1788970000.876433:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732034048 00000100:00100000:3.0:1788970000.876494:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:3.0:1788970000.876504:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732034048:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970000.876542:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970000.876566:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e98b expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970000.876595:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa18411, blocks: 0x1 00010000:00010000:3.0:1788970000.876614:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=312s v=(0 0) 00010000:00010000:3.0:1788970000.876619:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970000.876628:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e98b expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.876649:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e98b expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.876664:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd600, rc 0) 00000100:00100000:3.0:1788970000.876736:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732034048:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 233us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970000.876744:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:1.0:1788970000.878937:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.880418:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732034304 00000100:00100000:3.0:1788970000.880432:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732034304 00000100:00100000:2.0:1788970000.880651:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:2.0:1788970000.880663:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:10440:x1875870732034304:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788970000.880776:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:10440:x1875870732034304:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 115us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970000.880784:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:2.0:1788970000.885128:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.885217:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732034432 00000100:00100000:3.0:1788970000.885226:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732034432 00000100:00100000:3.0:1788970000.885293:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:3.0:1788970000.885304:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:10440:x1875870732034432:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970000.885324:0:8534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970000.885340:0:8534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e992 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.885394:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e98b expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.885403:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970000.885407:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970000.885412:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 7 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.885447:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e98b expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.885460:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e98b expref: 7 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970000.885471:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8534:1875870741492096:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970000.885563:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970000.893497:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8534:1875870741492096:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970000.893540:0:8534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 7 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970000.893565:0:8534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dce00, rc 0) 00000100:00100000:3.0:1788970000.893682:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:10440:x1875870732034432:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 8379us (8563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970000.893692:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:1.0:1788970000.899116:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970000.899478:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732034560 00000100:00100000:3.0:1788970000.899490:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732034560 00010000:00010000:2.0:1788970000.899607:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e98b expref: 7 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970000.899687:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:2.0:1788970000.899697:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778600e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732034560:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970000.899713:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970000.899739:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e98b expref: 7 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.899753:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e98b expref: 7 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.899776:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b4092 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e98b expref: 7 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.899817:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970000.899822:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970000.899831:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 6 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.899863:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 6 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970000.899900:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 6 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970000.899914:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778453761c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875870741492224:192.168.202.9@tcp:105: 00000100:00100000:2.0:1788970000.899991:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778784d4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970000.909432:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970000.909960:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732034688 00000100:00100000:0.0:1788970000.909971:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732034688 00002000:00100000:0.0:1788970000.910014:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97787ff21e00 x1875870732034688/t0(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:531/0 lens 504/0 e 0 to 0 dl 1788970011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970000.910024:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787ff21e00 with x1875870732034688 ext(0->8) 00002000:00010000:0.0:1788970000.910029:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787ff21e00 00000100:00100000:0.0:1788970000.910057:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1788970000.910066:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732034688:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788970000.910729:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2354:x1875870732034688:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 Request processed in 662us (1304us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788970000.910737:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00002000:00100000:0.0:1788970000.910744:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97787ff21e00 x1875870732034688/t4294967302(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:531/0 lens 504/448 e 0 to 0 dl 1788970011 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970000.910752:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787ff21e00 with x1875870732034688 ext(0->8) 00002000:00010000:0.0:1788970000.910756:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787ff21e00 00000100:00100000:3.0:1788970000.911142:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778453761c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875870741492224:192.168.202.9@tcp:105: 00010000:00010000:3.0:1788970000.911175:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970000.911222:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778600e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2354:x1875870732034560:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 11526us (12115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970000.911230:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:0.0:1788970000.916489:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970000.916576:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732034816 00000100:00100000:1.0:1788970000.916586:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732034816 00000100:00100000:1.0:1788970000.916640:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:1.0:1788970000.916650:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f466580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:10440:x1875870732034816:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788970000.972525:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788970000.972540:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788970000.972563:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1788970000.972591:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788970000.972713:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788970000.972723:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788970000.972729:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970000.972749:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741492352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788970000.972840:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970000.972905:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741492352 00000100:00100000:3.0:1788970000.972911:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741492352 00000100:00100000:3.0:1788970000.972955:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970000.972963:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741492352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788970000.973108:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788970000.973112:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788970001 00002000:00010000:3.0:1788970000.973298:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788970000.973301:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788970001 -> 1788970001 00002000:00010000:3.0:1788970000.973304:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788970000.973350:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741492352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 386us (509us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788970000.973357:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1788970000.973425:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff977880d430c0/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788970000.973431:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741492352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788970000.981115:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f466580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:10440:x1875870732034816:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 64455us (64625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970000.981129:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:0.0:1788970000.997406:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970000.997481:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732034944 00000100:00100000:1.0:1788970000.997491:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732034944 00000100:00100000:1.0:1788970000.997558:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:1.0:1788970000.997568:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f465a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2354:x1875870732034944:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788970001.059584:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788970001.059606:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788970001.060694:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f465a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732034944:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 63115us (63282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970001.060710:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:0.0:1788970001.063458:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.063536:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732035200 00000100:00100000:3.0:1788970001.063546:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732035200 00000100:00100000:3.0:1788970001.063621:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:3.0:1788970001.063631:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:10440:x1875870732035200:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788970001.063685:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970001.063714:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b408b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e984 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.063732:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:3.0:1788970001.063737:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970001.063767:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.063781:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.063817:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970001.064174:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b79cb8ad reply state 0000000002db295e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.064184:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970001.064524:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10440:x1875870732035200:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 893us (1075us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788970001.064533:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:2.0:1788970001.082634:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1788970001.082666:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.082676:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.082682:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.082686:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970001.082689:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.082694:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.082708:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:2.0:1788970001.082723:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970001.082727:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.082731:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970001.082908:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732035328 00000100:00100000:2.0:1788970001.082920:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732035328 00000100:00100000:2.0:1788970001.082977:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:2.0:1788970001.082987:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778453770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732035328:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788970001.083483:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788970001.083487:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788970001 -> 1788970000 00002000:00010000:2.0:1788970001.083490:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788969999 00002000:00010000:2.0:1788970001.083492:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788970001 -> 1788970000 00002000:00010000:2.0:1788970001.083495:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788970001.083562:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778453770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732035328:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 575us (936us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788970001.083571:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:3.0:1788970001.087590:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.087638:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732035584 00000100:00100000:3.0:1788970001.087647:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732035584 00000100:00100000:3.0:1788970001.087702:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:3.0:1788970001.087712:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:10440:x1875870732035584:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788970001.087779:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.087831:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e976 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.087840:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.087874:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e976 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.087900:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e976 expref: 13 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.087914:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d43840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741492480:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970001.088060:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970001.090491:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d43840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741492480:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970001.090520:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.091033:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.091282:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732035712 00000100:00100000:1.0:1788970001.091289:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732035712 00010000:00010000:1.0:1788970001.091322:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e976 expref: 14 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.091358:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:1.0:1788970001.091367:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d43840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:2354:x1875870732035712:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970001.091390:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970001.091396:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e976 expref: 14 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.091425:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e976 expref: 14 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.091447:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e976 expref: 14 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.091463:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:1.0:1788970001.091468:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.091477:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.091485:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.091510:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970001.091553:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d43840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2354:x1875870732035712:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 187us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970001.091561:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00010000:00010000:3.0:1788970001.091636:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.091653:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.091679:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.091686:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.091693:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.091699:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.091704:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.091711:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.091719:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:3.0:1788970001.091722:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788970001.091726:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.091732:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.091765:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:10440:x1875870732035584:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 Request processed in 4055us (4185us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788970001.091772:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:3.0:1788970001.093821:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.093853:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732035840 00000100:00100000:3.0:1788970001.093862:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732035840 00000100:00100000:3.0:1788970001.093907:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:3.0:1788970001.093916:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732035840:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788970001.093957:0:8534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.093990:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 7 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.093999:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788970001.094003:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970001.094007:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.094040:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 7 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.094054:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 7 pid: 8534 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.094069:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787857f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8534:1875870741492608:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970001.094140:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970001.100916:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.101222:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732035968 00000100:00100000:1.0:1788970001.101232:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732035968 00010000:00010000:1.0:1788970001.101271:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 8 pid: 8534 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.101317:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:1.0:1788970001.101326:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f465680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732035968:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970001.101354:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970001.101378:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 8 pid: 8534 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.101403:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 8 pid: 8534 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.101433:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970001.101438:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970001.101443:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.101453:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.101474:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970001.101529:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f465680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732035968:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 204us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970001.101537:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00010000:00010000:3.0:1788970001.101906:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c234b9ce/0x5d0de860b05b4099 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e992 expref: 7 pid: 8534 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.101932:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787857f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8534:1875870741492608:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970001.101953:0:8534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.101963:0:8534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.101971:0:8534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.102336:0:8534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.102346:0:8534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.102354:0:8534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.102361:0:8534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970001.102365:0:8534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.102373:0:8534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.102405:0:8534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.102413:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b40ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.102477:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732035840:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 8561us (8663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970001.102486:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:3.0:1788970001.106621:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970001.106693:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732036224 00000100:00100000:2.0:1788970001.106703:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732036224 00000100:00100000:2.0:1788970001.106761:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:2.0:1788970001.106770:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:10440:x1875870732036224:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788970001.106875:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.106903:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.106930:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.107136:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.107146:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e97d expref: 13 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.107155:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.107190:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e97d expref: 13 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.107206:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e97d expref: 13 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970001.107219:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977845377840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741492736:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970001.107297:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970001.109242:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977845377840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741492736:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970001.109267:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970001.110246:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.110304:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732036352 00000100:00100000:1.0:1788970001.110311:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732036352 00010000:00010000:1.0:1788970001.110343:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e97d expref: 14 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.110376:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:1.0:1788970001.110394:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:2354:x1875870732036352:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970001.110407:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970001.110427:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e97d expref: 14 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.110439:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e97d expref: 14 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.110460:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e97d expref: 14 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.110476:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:1.0:1788970001.110481:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.110490:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.110497:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.110526:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970001.110577:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2354:x1875870732036352:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 192us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970001.110584:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00010000:00010000:3.0:1788970001.110693:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.110700:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970001.110921:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788970001.111080:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788970001.111125:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788970001.111211:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1875870741492864:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788970001.111257:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970001.111285:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e166c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970001.111560:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741492864 00000100:00100000:1.0:1788970001.111566:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741492864 00000100:00100000:1.0:1788970001.111609:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970001.111617:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875870741492864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788970001.111676:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875870741492864:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970001.111697:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788970001.111716:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970001.111867:0:5834:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788970001.111877:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff977880d430c0, transno 4294967303 00000100:00100000:3.0:1788970001.111903:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1875870741492864:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788970001.112528:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788970001.112592:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3d9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1875870741492992:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788970001.112628:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970001.112647:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970001.112951:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741492992 00000100:00100000:1.0:1788970001.112957:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741492992 00000100:00100000:1.0:1788970001.113000:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970001.113007:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875870741492992:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788970001.113148:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1875870741492992:12345-0@lo:1000:mdt00_002.0 Request processed in 141us (519us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788970001.113155:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970001.113404:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3d9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1875870741492992:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788970001.113434:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113444:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113451:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113457:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.113462:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113471:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113485:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:3.0:1788970001.113488:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970001.113492:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113498:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b40bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113547:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113554:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113560:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113565:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.113568:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113574:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113583:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672200) 00010000:00010000:3.0:1788970001.113585:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970001.113588:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113594:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b3ff1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113614:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113627:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e961 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113636:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113667:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e961 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.113682:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e961 expref: 16 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.113694:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741493120:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970001.113758:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970001.121313:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.121406:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741493120:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970001.121434:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.121549:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732036480 00000100:00100000:1.0:1788970001.121557:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732036480 00010000:00010000:1.0:1788970001.121596:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e961 expref: 17 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.121641:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:1.0:1788970001.121652:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:2353:x1875870732036480:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970001.121668:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970001.121674:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e961 expref: 17 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.121685:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e961 expref: 17 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.121720:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b400d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e961 expref: 17 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.121736:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672200) 00010000:00010000:1.0:1788970001.121753:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.121774:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.121782:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.121832:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970001.121889:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:2353:x1875870732036480:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 230us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970001.121897:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00010000:00010000:3.0:1788970001.122086:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122094:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122106:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122112:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122119:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122124:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.122128:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122142:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122150:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672200) 00010000:00010000:3.0:1788970001.122153:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970001.122157:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122163:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122174:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122180:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122185:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122190:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.122193:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122199:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122207:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672200) 00010000:00010000:3.0:1788970001.122209:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788970001.122212:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.122227:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b40b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.122431:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:10440:x1875870732036224:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 15662us (15821us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788970001.122440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 83 00000020:00080000:3.0:1788970001.122444:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788970001.122567:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970001.122571:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970001.122598:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788970001.122603:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788970001.131767:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.131888:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732036736 00000100:00100000:1.0:1788970001.131898:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732036736 00000100:00100000:1.0:1788970001.131948:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:1.0:1788970001.131957:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:10440:x1875870732036736:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788970001.132626:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788970001.132743:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788970001.132785:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.132842:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.132855:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.132864:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.132884:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.132890:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.132913:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788970001.133010:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:10440:x1875870732036736:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 1051us (1252us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788970001.133018:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000020:00080000:1.0:1788970001.133024:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788970001.133924:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970001.133932:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.133941:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970001.133945:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.133965:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.134004:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9778519abc00) 00010000:00010000:0.0:1788970001.134008:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788970001.134014:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.134020:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b40ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.134040:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970001.134042:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970001.134044:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970001.358499:0:11972:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970001.358509:0:11972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970001.358547:0:11972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788970001.358552:0:11972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788970001.479892:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970001.538040:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.538075:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732036992 00000100:00100000:3.0:1788970001.538086:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732036992 00000100:00100000:3.0:1788970001.538137:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:3.0:1788970001.538148:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:10450:x1875870732036992:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970001.538173:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970001.538195:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e999 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.538297:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b40d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.538312:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b40d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.538323:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b40d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970001.538342:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788970001.538465:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b40d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e999 expref: 20 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.538482:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b40d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e999 expref: 19 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.538490:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970001.538493:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788970001.538497:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dce00, rc 0) 00000100:00100000:3.0:1788970001.538548:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10450:x1875870732036992:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 403us (519us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788970001.538555:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:3.0:1788970001.545705:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.545741:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732037120 00000100:00100000:3.0:1788970001.545749:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732037120 00000100:00100000:3.0:1788970001.545823:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:3.0:1788970001.545834:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10450:x1875870732037120:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:3.0:1788970001.545923:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.545944:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.545956:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.545974:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.545989:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.545996:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548470:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548489:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548501:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970001.548549:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548563:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548569:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548576:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548582:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.548586:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548593:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548617:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970001.548620:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970001.548624:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548630:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b40e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548644:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548649:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548654:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548659:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.548661:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548666:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548673:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977858b3cc00) 00010000:00010000:3.0:1788970001.548675:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970001.548678:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548683:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b40ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548711:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548717:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548723:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548728:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.548730:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548736:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548742:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3c900) 00010000:00010000:3.0:1788970001.548744:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970001.548747:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.548753:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b40f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.550687:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10450:x1875870732037120:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 4846us (4983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970001.550700:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:3.0:1788970001.604100:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970001.604169:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732037376 00000100:00100000:0.0:1788970001.604194:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732037376 00000100:00100000:0.0:1788970001.604259:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:0.0:1788970001.604266:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10453:x1875870732037376:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970001.604283:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970001.604301:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b40fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9a0 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.604360:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.604373:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.604391:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.604427:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.604435:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.604441:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.604719:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.604728:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.604736:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970001.604746:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788970001.605331:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605341:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605347:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605353:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970001.605357:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605375:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605398:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:0.0:1788970001.605401:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970001.605407:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605413:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4102 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605428:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605434:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605439:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605445:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970001.605447:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605453:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605460:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977849672900) 00010000:00010000:0.0:1788970001.605462:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970001.605465:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605481:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605525:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b40fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a0 expref: 22 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605539:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a0 expref: 21 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.605547:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:0.0:1788970001.605549:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970001.605552:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484800, rc 0) 00000100:00100000:0.0:1788970001.605623:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10453:x1875870732037376:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1356us (1538us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788970001.605631:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:3.0:1788970001.609226:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.609487:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732037504 00000100:00100000:1.0:1788970001.609502:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732037504 00000100:00100000:1.0:1788970001.609578:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:1.0:1788970001.609592:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10453:x1875870732037504:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1788970001.609694:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.609716:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.609732:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.609857:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.609866:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.610020:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.610028:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970001.610033:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.610042:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.610055:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:1.0:1788970001.610058:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970001.610064:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.610071:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b411e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.610179:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10453:x1875870732037504:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 589us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970001.610188:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:3.0:1788970001.613253:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.613364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732037760 00000100:00100000:1.0:1788970001.613386:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732037760 00000100:00100000:1.0:1788970001.613463:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:1.0:1788970001.613476:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10453:x1875870732037760:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970001.613842:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:10453:x1875870732037760:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 367us (601us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788970001.613851:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:0.0:1788970001.642339:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.645359:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732038016 00000100:00100000:3.0:1788970001.645376:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732038016 00000100:00100000:3.0:1788970001.645459:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:3.0:1788970001.645470:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f466d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:9983:x1875870732038016:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1788970001.645497:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970001.645519:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4125 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9a7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.645622:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.645637:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a0 expref: 23 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.645645:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.645681:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a0 expref: 23 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.645695:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a0 expref: 23 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.645708:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741493248:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970001.646307:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970001.656215:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.656858:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732038144 00000100:00100000:1.0:1788970001.656873:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732038144 00010000:00010000:1.0:1788970001.656948:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a0 expref: 24 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.657001:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:1.0:1788970001.657012:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845375a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:2353:x1875870732038144:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970001.657034:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970001.657042:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a0 expref: 24 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.657059:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a0 expref: 24 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.657087:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:1.0:1788970001.657094:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.657107:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.657115:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.657139:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970001.657689:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a0 expref: 24 pid: 7061 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.657714:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741493248:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970001.657762:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.657773:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.657779:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970001.657940:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788970001.658154:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4125 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a7 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.658175:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a7 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.658185:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:3.0:1788970001.658188:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788970001.658192:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc000, rc 0) 00000100:00100000:1.0:1788970001.658320:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845375a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:2353:x1875870732038144:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1307us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970001.658332:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:3.0:1788970001.659452:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f466d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:9983:x1875870732038016:12345-192.168.202.9@tcp:101:bash.0 Request processed in 13972us (17111us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788970001.659465:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:2.0:1788970001.663022:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.663119:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732038400 00000100:00100000:1.0:1788970001.663148:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732038400 00000100:00100000:1.0:1788970001.663222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:1.0:1788970001.663233:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:9983:x1875870732038400:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:1.0:1788970001.666194:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.666229:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.666305:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970001.666372:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788970001.666413:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d67a6c6 reply state 0000000088f3ed31 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.666424:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788970001.666473:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788970001.667774:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:9983:x1875870732038400:12345-192.168.202.9@tcp:36:bash.0 Request processed in 4529us (4753us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788970001.667859:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 89 00000020:00080000:0.0:1788970001.667869:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788970001.671127:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.671151:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.671160:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.671187:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.671193:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.671202:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.671223:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:3.0:1788970001.671226:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970001.671232:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.671239:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b413a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970001.672990:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970001.673190:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732038528 00000100:00100000:0.0:1788970001.673204:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732038528 00000100:00100000:0.0:1788970001.673283:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:0.0:1788970001.673295:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:9983:x1875870732038528:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970001.673326:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970001.673350:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9ae expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.673458:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ae expref: 27 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.673475:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ae expref: 27 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.673500:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:0.0:1788970001.673504:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970001.673508:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484e00, rc 0) 00000100:00100000:0.0:1788970001.673589:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:9983:x1875870732038528:12345-192.168.202.9@tcp:101:bash.0 Request processed in 297us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970001.673597:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:1.0:1788970001.679301:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970001.679982:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732038656 00000100:00100000:2.0:1788970001.679995:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732038656 00000100:00100000:2.0:1788970001.680083:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:2.0:1788970001.680096:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:9983:x1875870732038656:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970001.680121:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970001.680161:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9b5 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970001.680193:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa18410, atime: 0x6aa1840f, ctime: 0x6aa18410, blocks: 0xb 00010000:00010000:2.0:1788970001.680223:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1788970001.680229:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970001.680239:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9b5 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.680261:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9b5 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.680276:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c400, rc 0) 00000100:00100000:2.0:1788970001.680344:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:9983:x1875870732038656:12345-192.168.202.9@tcp:101:bash.0 Request processed in 251us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970001.680351:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:2.0:1788970001.683218:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.683333:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732038784 00000100:00100000:3.0:1788970001.683346:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732038784 00002000:00010000:3.0:1788970001.683415:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788970001.683422:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff977845376580 with x1875870732038784 ext(0->18446744073709551615) 00002000:00010000:3.0:1788970001.683439:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff977845376580. 00000100:00100000:3.0:1788970001.683529:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:3.0:1788970001.683542:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845376580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732038784:12345-192.168.202.9@tcp:10:bash.0 00002000:00010000:3.0:1788970001.683992:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788970001.683996:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788970000 -> 1788970002 00002000:00010000:3.0:1788970001.683999:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788969999 -> 1788969999 00002000:00010000:3.0:1788970001.684001:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788970000 -> 1788970002 00002000:00010000:3.0:1788970001.684003:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788970001.684067:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845376580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732038784:12345-192.168.202.9@tcp:10:bash.0 Request processed in 528us (862us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788970001.684095:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00002000:00010000:3.0:1788970001.684099:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788970001.684102:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff977845376580 with x1875870732038784 ext(0->18446744073709551615) 00002000:00010000:3.0:1788970001.684107:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff977845376580. 00000100:00100000:3.0:1788970001.778780:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970001.778935:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732038912 00000100:00100000:0.0:1788970001.778957:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732038912 00000100:00100000:0.0:1788970001.779040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00100000:0.0:1788970001.779053:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10467:x1875870732038912:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:0.0:1788970001.779152:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779173:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779187:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779203:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779232:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779239:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779583:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779592:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779600:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970001.779651:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779663:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779671:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779678:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779685:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970001.779689:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779697:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779717:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:0.0:1788970001.779720:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970001.779726:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779733:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b414f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779745:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779751:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779757:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779762:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970001.779765:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779771:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779777:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977849672900) 00010000:00010000:0.0:1788970001.779779:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970001.779781:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779787:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b4156 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779853:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779860:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779867:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779872:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970001.779875:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779880:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779887:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:0.0:1788970001.779889:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970001.779892:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.779898:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b415d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970001.779997:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10467:x1875870732038912:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 944us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970001.780005:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00100000:1.0:1788970001.827202:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.827372:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732039168 00000100:00100000:3.0:1788970001.827394:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732039168 00000100:00100000:3.0:1788970001.827485:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:3.0:1788970001.827500:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:10470:x1875870732039168:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970001.827530:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970001.827562:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9bc expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.827668:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.827686:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.827701:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.827720:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.827729:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.827737:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828457:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828471:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828480:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970001.828494:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788970001.828628:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828638:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828646:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828653:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.828659:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828668:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828684:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970001.828688:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970001.828694:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828715:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b416b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828733:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828739:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828745:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.828751:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.828754:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.829418:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.829430:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977858b3c900) 00010000:00010000:3.0:1788970001.829433:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970001.829437:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.829444:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.829517:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9bc expref: 30 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.829534:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9bc expref: 29 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.829552:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:3.0:1788970001.829555:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788970001.829558:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd400, rc 0) 00000100:00100000:3.0:1788970001.829663:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:10470:x1875870732039168:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 2167us (2477us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788970001.829674:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:2.0:1788970001.834745:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970001.834951:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732039296 00000100:00100000:0.0:1788970001.834966:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732039296 00000100:00100000:0.0:1788970001.835045:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:0.0:1788970001.835075:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:10470:x1875870732039296:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:0.0:1788970001.835185:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.835208:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a7 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.835221:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.835268:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a7 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970001.835286:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a7 expref: 29 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970001.835304:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f465e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741493376:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970001.835432:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970001.839913:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.840065:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732039552 00000100:00100000:1.0:1788970001.840079:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732039552 00000100:00100000:1.0:1788970001.840166:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:1.0:1788970001.840179:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:5595:x1875870732039552:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788970001.840711:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:5595:x1875870732039552:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 534us (812us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788970001.840722:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:0.0:1788970001.841104:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f465e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741493376:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970001.841150:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.844229:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.844577:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732039680 00000100:00100000:3.0:1788970001.844591:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732039680 00010000:00010000:3.0:1788970001.844657:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a7 expref: 31 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.844714:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:3.0:1788970001.844727:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:2354:x1875870732039680:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970001.844748:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970001.844756:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a7 expref: 31 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.844784:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a7 expref: 31 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.844857:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b412c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9a7 expref: 31 pid: 5832 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.845001:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:3.0:1788970001.845009:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.845039:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.845050:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.845088:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970001.845368:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:2354:x1875870732039680:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 642us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970001.845386:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00010000:00010000:1.0:1788970001.846648:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.846689:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.846737:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.846745:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.846754:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.846772:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970001.846779:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.846826:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.846847:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:1.0:1788970001.846851:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970001.846857:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.846865:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b4187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970001.847512:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:10470:x1875870732039296:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 12432us (12775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970001.847527:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:3.0:1788970001.852413:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.852564:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732039936 00000100:00100000:1.0:1788970001.852579:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732039936 00000100:00100000:1.0:1788970001.852658:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:1.0:1788970001.852671:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:10470:x1875870732039936:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970001.853523:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10470:x1875870732039936:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 851us (1124us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788970001.853536:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:2.0:1788970001.944617:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970001.944752:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732040192 00000100:00100000:1.0:1788970001.944914:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732040192 00000100:00100000:1.0:1788970001.945112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:1.0:1788970001.945126:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778453761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10481:x1875870732040192:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:1.0:1788970001.945161:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970001.945194:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b418e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9c3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945300:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945319:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945334:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945354:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945362:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945406:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945818:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b41a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945830:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b41a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945839:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b41a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970001.945850:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788970001.945987:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.945996:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946004:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946011:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970001.946016:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946026:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946040:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:1.0:1788970001.946044:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970001.946060:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946067:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946082:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946088:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946094:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946100:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970001.946103:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946109:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946117:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9778519ab100) 00010000:00010000:1.0:1788970001.946119:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970001.946122:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946127:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b419c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946187:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b418e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9c3 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946216:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b41a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9c3 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970001.946223:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:1.0:1788970001.946226:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970001.946229:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92a00, rc 0) 00000100:00100000:1.0:1788970001.946327:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778453761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:10481:x1875870732040192:12345-192.168.202.9@tcp:101:cat.0 Request processed in 1204us (1727us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788970001.946336:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:3.0:1788970001.951305:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970001.951432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732040448 00000100:00100000:2.0:1788970001.951446:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732040448 00000100:00100000:2.0:1788970001.951556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:2.0:1788970001.951570:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:10481:x1875870732040448:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:2.0:1788970001.951947:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:10481:x1875870732040448:12345-192.168.202.9@tcp:35:cat.0 Request processed in 371us (649us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788970001.951976:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:2.0:1788970001.971453:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970001.971606:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732040704 00000100:00100000:3.0:1788970001.971619:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732040704 00000100:00100000:3.0:1788970001.971704:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00100000:3.0:1788970001.971717:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:10482:x1875870732040704:12345-192.168.202.9@tcp:36:rm.0 00010000:00010000:3.0:1788970001.971846:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788970001.971903:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b41a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9c3 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.971933:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9bc expref: 32 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.971960:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ae expref: 31 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.971971:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977849672000) 00010000:00010000:3.0:1788970001.972004:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970001.972030:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.972048:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.972060:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.972076:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.972083:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.972089:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.972433:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.972443:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.972450:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970001.973181:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788970001.973194:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313936403964ns, next at 314936400731ns, rc = 0 00010000:00010000:3.0:1788970001.973270:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973294:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973303:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973312:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973318:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973324:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973354:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970001.973391:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973399:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973406:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973413:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.973419:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973429:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973454:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:3.0:1788970001.973457:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788970001.973464:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973471:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973494:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973500:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973506:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973511:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970001.973514:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973520:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973527:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970001.973530:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970001.973533:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970001.973538:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b41b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970001.973561:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013863157 reply state 000000003b22084f transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970001.973571:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970001.973693:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:10482:x1875870732040704:12345-192.168.202.9@tcp:36:rm.0 Request processed in 1975us (2251us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788970001.973704:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 95 00010000:00010000:2.0:1788970001.974459:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970001.974470:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.974479:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970001.974483:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.974492:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.974504:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff977858b3cc00) 00010000:00010000:2.0:1788970001.974507:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788970001.974511:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.974517:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.974538:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970001.974541:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970001.974542:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970001.979339:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.979366:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.979384:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.979416:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970001.979423:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.979434:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.979456:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977858b3c900) 00010000:00010000:2.0:1788970001.979460:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970001.979466:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970001.979474:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970002.034451:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970002.034668:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732040960 00000100:00100000:3.0:1788970002.034683:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732040960 00000100:00080000:1.0:1788970002.034851:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970002.035094:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:3.0:1788970002.035112:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:10488:x1875870732040960:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1788970002.035149:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970002.035184:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b41cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9ca expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.035357:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.035388:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.035403:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.035425:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.035433:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.035461:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788970002.036341:0:7061:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788970002.036634:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.036650:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.036660:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.036707:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.036715:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.036724:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.036730:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970002.036735:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.036743:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.037544:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970002.037551:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970002.037577:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.037586:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b41d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970002.037610:0:7061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075af5f2e reply state 000000005eca4eee transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970002.037620:0:7061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788970002.037674:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b41cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ca expref: 34 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.037690:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ca expref: 33 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.037699:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff977858b3c700) 00010000:00010000:3.0:1788970002.037701:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970002.037704:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dde00, rc 0) 00000100:00100000:3.0:1788970002.037864:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:10488:x1875870732040960:12345-192.168.202.9@tcp:101:bash.0 Request processed in 2757us (3425us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788970002.037882:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:3.0:1788970002.042284:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.042529:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732041088 00000100:00100000:1.0:1788970002.042542:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732041088 00000100:00100000:1.0:1788970002.042629:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:1.0:1788970002.042640:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732041088:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1788970002.042664:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970002.042693:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970002.042726:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970002.042751:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:1.0:1788970002.042766:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970002.042777:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d1 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.042829:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d1 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.042863:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92000, rc 0) 00000100:00080000:3.0:1788970002.043286:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970002.043742:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732041088:12345-192.168.202.9@tcp:101:bash.0 Request processed in 1099us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970002.043753:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00010000:00010000:2.0:1788970002.043867:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.043888:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.043897:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.043903:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970002.043909:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.043919:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.043960:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977858b3c400) 00010000:00010000:2.0:1788970002.043964:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970002.043970:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.043977:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b41db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.047145:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970002.047251:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732041216 00000100:00100000:3.0:1788970002.047264:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732041216 00000100:00100000:3.0:1788970002.047334:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:3.0:1788970002.047345:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:10488:x1875870732041216:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1788970002.047370:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970002.047427:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9d8 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.047476:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d1 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.047488:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970002.047494:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970002.047501:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.047546:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d1 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.047564:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d1 expref: 9 pid: 6676 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970002.047584:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1875870741493504:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970002.047732:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e160c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970002.050835:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1875870741493504:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970002.050900:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.050929:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc000, rc 0) 00000100:00100000:2.0:1788970002.051013:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:10488:x1875870732041216:12345-192.168.202.9@tcp:101:bash.0 Request processed in 3669us (3882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970002.051025:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:0.0:1788970002.054220:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970002.054332:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732041344 00000100:00100000:3.0:1788970002.054348:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732041344 00010000:00010000:3.0:1788970002.054424:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d1 expref: 9 pid: 6676 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970002.054478:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:3.0:1788970002.054490:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778600e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2354:x1875870732041344:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970002.054528:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970002.054563:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d1 expref: 9 pid: 6676 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.054582:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d1 expref: 9 pid: 6676 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.054619:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002be36b94/0x5d0de860b05b41f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d1 expref: 9 pid: 6676 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.054641:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970002.054646:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970002.054657:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.054669:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.054718:0:11142:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970002.054737:0:11142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878928f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11142:1875870741493632:192.168.202.9@tcp:105: 00000100:00100000:3.0:1788970002.054902:0:11142:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970002.058240:0:11142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878928f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11142:1875870741493632:192.168.202.9@tcp:105: 00010000:00010000:3.0:1788970002.058299:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970002.058409:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778600e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2354:x1875870732041344:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3920us (4203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970002.058422:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:2.0:1788970002.062318:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.062686:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732041600 00000100:00100000:1.0:1788970002.062701:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732041600 00000100:00100000:1.0:1788970002.062786:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:1.0:1788970002.062832:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:10488:x1875870732041600:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:1.0:1788970002.063531:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:10488:x1875870732041600:12345-192.168.202.9@tcp:35:bash.0 Request processed in 698us (1223us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788970002.063542:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:0.0:1788970002.280595:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970002.284481:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732041728 00000100:00100000:3.0:1788970002.284504:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732041728 00000100:00100000:3.0:1788970002.284667:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:3.0:1788970002.284681:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f465e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:10504:x1875870732041728:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970002.284714:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970002.284743:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9df expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.284850:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.284868:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.284894:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970002.284957:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788970002.284962:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970002.284985:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.285015:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b41fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9df expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.285040:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4205 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9df expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.285076:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970002.285081:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970002.285086:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd400, rc 0) 00000100:00100000:3.0:1788970002.285185:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f465e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:10504:x1875870732041728:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 507us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970002.285193:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:3.0:1788970002.293607:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970002.294686:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732041984 00000100:00100000:2.0:1788970002.294701:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732041984 00000100:00100000:3.0:1788970002.294850:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:3.0:1788970002.294867:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878928f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:10504:x1875870732041984:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970002.295056:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970002.295087:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b420c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9e6 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.295223:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.295242:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.295257:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970002.295269:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788970002.295642:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b420c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9e6 expref: 38 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.295665:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9e6 expref: 37 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.295693:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff977858b3c700) 00010000:00010000:3.0:1788970002.295696:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970002.295700:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8e00, rc 0) 00000100:00100000:3.0:1788970002.295833:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878928f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:10504:x1875870732041984:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 972us (2242us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788970002.295840:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:2.0:1788970002.301496:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.301638:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732042240 00000100:00100000:1.0:1788970002.301652:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732042240 00000100:00100000:1.0:1788970002.301731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:1.0:1788970002.301743:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:10504:x1875870732042240:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970002.301813:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970002.301843:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b4221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.301978:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4228 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.301999:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.302035:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970002.302052:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788970002.302215:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b4221 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ed expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.302235:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ed expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.302244:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff977858b3c700) 00010000:00010000:1.0:1788970002.302247:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788970002.302252:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93400, rc 0) 00000100:00100000:1.0:1788970002.302342:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+39:10504:x1875870732042240:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 600us (870us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788970002.302350:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:0.0:1788970002.308913:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970002.312785:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732042368 00000100:00100000:3.0:1788970002.312980:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732042368 00000100:00100000:2.0:1788970002.313599:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:2.0:1788970002.313613:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+39:2354:x1875870732042368:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970002.313636:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970002.313671:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4213 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9e6 expref: 39 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.313722:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff977858b3c700) 00010000:00010000:2.0:1788970002.313729:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970002.313844:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:2354:x1875870732042368:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 233us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970002.313852:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:2.0:1788970002.313975:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970002.314602:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732042496 00000100:00100000:0.0:1788970002.314613:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732042496 00000100:00100000:0.0:1788970002.314662:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:0.0:1788970002.314684:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2356:x1875870732042496:12345-192.168.202.9@tcp:1:lfs.0 00010000:00010000:0.0:1788970002.314736:0:8534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.314761:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.314771:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970002.314777:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970002.314782:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.314855:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.315232:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 8 pid: 6678 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970002.315254:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f467c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8534:1875870741493760:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970002.315431:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970002.320537:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f467c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8534:1875870741493760:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970002.320582:0:8534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.320855:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970002.320944:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732042624 00000100:00100000:0.0:1788970002.320952:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732042624 00002000:00100000:0.0:1788970002.321021:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97787ff23480 x1875870732042624/t0(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:533/0 lens 504/0 e 0 to 0 dl 1788970013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970002.321033:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787ff23480 with x1875870732042624 ext(0->8) 00010000:00010000:0.0:1788970002.321042:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 9 pid: 6678 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.321058:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 9 pid: 6678 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970002.321067:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97787ff23480 00000100:00100000:0.0:1788970002.321104:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:0.0:1788970002.321114:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2354:x1875870732042624:12345-192.168.202.9@tcp:4:lfs.0 00000100:00100000:0.0:1788970002.321748:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:2354:x1875870732042624:12345-192.168.202.9@tcp:4:lfs.0 Request processed in 632us (891us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788970002.321758:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00002000:00100000:0.0:1788970002.321768:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97787ff23480 x1875870732042624/t4294967302(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:533/0 lens 504/448 e 0 to 0 dl 1788970013 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970002.321776:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787ff23480 with x1875870732042624 ext(0->8) 00010000:00010000:0.0:1788970002.321781:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 11 pid: 6678 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.321838:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 11 pid: 6678 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970002.321847:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97787ff23480 00000100:00100000:2.0:1788970002.325345:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.325467:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732042752 00000100:00100000:1.0:1788970002.325482:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732042752 00010000:00010000:1.0:1788970002.325536:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 11 pid: 6678 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.325589:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:1.0:1788970002.325600:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:2355:x1875870732042752:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970002.325621:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788970002.325647:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788970002.325669:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788970002 00002000:00010000:1.0:1788970002.325672:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788970002 00002000:00010000:1.0:1788970002.325674:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788970002 00010000:00010000:1.0:1788970002.325684:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 11 pid: 6678 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.325703:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 11 pid: 6678 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.325732:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b41f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9d8 expref: 11 pid: 6678 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.325754:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970002.325768:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970002.325775:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.325787:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.325887:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970002.325960:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:2355:x1875870732042752:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 360us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970002.325968:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00010000:00010000:0.0:1788970002.327284:0:8534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.327303:0:8534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.327345:0:8534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.327355:0:8534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.327364:0:8534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.327384:0:8534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970002.327389:0:8534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.327399:0:8534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.327419:0:8534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.327426:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e586e2d3/0x5d0de860b05b4236 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970002.327558:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2356:x1875870732042496:12345-192.168.202.9@tcp:1:lfs.0 Request processed in 12873us (13579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970002.327570:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:2.0:1788970002.333112:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.333205:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732043008 00000100:00100000:1.0:1788970002.333223:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732043008 00000100:00100000:1.0:1788970002.333296:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:1.0:1788970002.333308:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:10504:x1875870732043008:12345-192.168.202.9@tcp:35:lfs.0 00000004:00010000:1.0:1788970002.333443:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ed expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970002.334177:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788970002.334232:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788970002.338656:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788970002.338822:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.338849:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ca expref: 42 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.338860:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.339429:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ca expref: 42 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.339454:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ca expref: 42 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.339474:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff221c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875870741493888:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970002.339666:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970002.352493:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.353449:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff221c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875870741493888:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970002.353492:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970002.353708:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732043136 00000100:00100000:3.0:1788970002.353720:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732043136 00010000:00010000:3.0:1788970002.353784:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ca expref: 43 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970002.354188:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:3.0:1788970002.354202:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+43:2354:x1875870732043136:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970002.354227:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970002.354237:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ca expref: 43 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.354253:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ca expref: 43 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.354295:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b41e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ca expref: 43 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.354317:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff977858b3c700) 00010000:00010000:3.0:1788970002.354341:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.354353:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.354362:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.354408:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970002.354489:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+42:2354:x1875870732043136:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 290us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970002.354498:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00010000:00010000:1.0:1788970002.354561:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.354577:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970002.354755:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788970002.355346:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788970002.355507:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff221c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741494016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788970002.355608:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970002.355669:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741494016 00000100:00100000:1.0:1788970002.355678:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741494016 00000100:00100000:1.0:1788970002.355744:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970002.355754:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875870741494016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788970002.355876:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875870741494016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 124us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970002.355884:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788970002.355913:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970002.355957:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847233cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970002.355989:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff221c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741494016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788970002.356514:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788970002.356598:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff221c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741494144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788970002.356644:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970002.356677:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741494144 00000100:00100000:1.0:1788970002.356682:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741494144 00000100:00100000:1.0:1788970002.356712:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970002.356719:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875870741494144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788970002.356911:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5836:x1875870741494144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 191us (266us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788970002.356928:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970002.356951:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970002.356973:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff221c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741494144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788970002.357016:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788970002.357052:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.357064:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.357072:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.357079:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970002.357084:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.357092:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.357110:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff977858b3c700) 00010000:00010000:1.0:1788970002.357113:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788970002.357119:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.357125:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b423d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788970002.357317:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788970002.357470:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788970002.357493:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 314320702820ns, next at 315320700163ns, rc = 0 00000001:00080000:1.0:1788970002.357502:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788970002.357542:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff977858b3c700) 00010000:00010000:1.0:1788970002.357545:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788970002.357554:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4228 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9ed expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.357670:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+45:10504:x1875870732043008:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 24365us (24577us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788970002.357679:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000020:00080000:1.0:1788970002.357683:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788970002.362030:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.362542:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732043264 00000100:00100000:1.0:1788970002.362558:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732043264 00000100:00100000:1.0:1788970002.362638:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:1.0:1788970002.362651:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+45:10504:x1875870732043264:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970002.362685:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970002.362720:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4244 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.362829:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4244 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9f4 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.362848:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4244 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9f4 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.363104:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970002.363108:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970002.363114:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93600, rc 0) 00000100:00100000:1.0:1788970002.363210:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+46:10504:x1875870732043264:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 560us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970002.363219:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:2.0:1788970002.373527:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.373630:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732043520 00000100:00100000:1.0:1788970002.373645:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732043520 00000100:00100000:1.0:1788970002.373726:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:1.0:1788970002.373739:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+46:10504:x1875870732043520:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970002.374159:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+47:10504:x1875870732043520:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 421us (648us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788970002.374169:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00010000:00010000:3.0:1788970002.501065:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970002.516863:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970002.516978:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732043648 00000100:00100000:3.0:1788970002.516989:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732043648 00000100:00100000:3.0:1788970002.517071:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:3.0:1788970002.517082:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+47:10514:x1875870732043648:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:3.0:1788970002.517163:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517181:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517193:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517210:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517217:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517235:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517339:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517347:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517354:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970002.517408:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517422:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517428:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517435:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517441:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970002.517445:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517451:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517463:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970002.517472:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970002.517478:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517485:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b424b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517502:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517508:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517514:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517518:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970002.517521:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517526:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517533:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977858b3c600) 00010000:00010000:3.0:1788970002.517535:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970002.517538:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517543:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4252 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517557:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517569:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517574:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517579:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970002.517582:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517587:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517594:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:3.0:1788970002.517597:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970002.517600:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.517606:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970002.517740:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+47:10514:x1875870732043648:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 659us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970002.517749:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:3.0:1788970002.578709:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970002.578845:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732043904 00000100:00100000:0.0:1788970002.578861:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732043904 00000100:00100000:0.0:1788970002.578955:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 102 00000100:00100000:0.0:1788970002.578967:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878929a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+47:10517:x1875870732043904:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970002.578996:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970002.579024:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4e9fb expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579130:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579148:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579161:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579178:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579185:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579192:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579389:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579399:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579405:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970002.579417:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788970002.579548:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579557:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579564:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579570:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970002.579577:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579585:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579599:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:0.0:1788970002.579603:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970002.579609:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579627:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4267 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579644:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579651:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579657:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579662:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970002.579666:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579672:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579681:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977849672900) 00010000:00010000:0.0:1788970002.579683:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970002.579686:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579692:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b426e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579745:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9fb expref: 50 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579762:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9fb expref: 49 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.579779:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:0.0:1788970002.579782:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970002.579785:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484e00, rc 0) 00000100:00100000:0.0:1788970002.579936:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878929a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+49:10517:x1875870732043904:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 970us (1243us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788970002.579945:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 102 00000100:00100000:2.0:1788970002.586365:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970002.586577:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732044032 00000100:00100000:3.0:1788970002.586591:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732044032 00000100:00100000:3.0:1788970002.586719:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:3.0:1788970002.586732:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+49:10517:x1875870732044032:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:3.0:1788970002.586892:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.586915:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.586930:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.587310:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.587318:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.587325:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.587332:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970002.587337:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.587346:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.587360:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:3.0:1788970002.587364:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970002.587382:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.587389:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970002.587951:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+49:10517:x1875870732044032:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 1205us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970002.587963:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:2.0:1788970002.591214:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.591340:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732044288 00000100:00100000:1.0:1788970002.591353:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732044288 00000100:00100000:1.0:1788970002.591532:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:1.0:1788970002.591545:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+49:10517:x1875870732044288:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970002.592156:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+50:10517:x1875870732044288:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 610us (953us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788970002.592166:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:2.0:1788970002.697718:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970002.698290:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732044544 00000100:00100000:0.0:1788970002.698305:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732044544 00000100:00100000:1.0:1788970002.698546:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 104 00000100:00100000:1.0:1788970002.698563:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+50:10527:x1875870732044544:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1788970002.698599:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970002.698603:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788970002.698639:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4205 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9df expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.698667:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:1.0:1788970002.698674:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970002.698708:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b428a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea02 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.699329:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.699346:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.699359:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970002.699386:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788970002.699567:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b428a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.699585:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.699594:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970002.699597:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970002.699601:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93e00, rc 0) 00000100:00100000:1.0:1788970002.699693:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+51:10527:x1875870732044544:12345-192.168.202.9@tcp:101:bash.0 Request processed in 1134us (1989us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788970002.699701:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 104 00000100:00100000:3.0:1788970002.703408:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.703550:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732044928 00000100:00100000:1.0:1788970002.703566:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732044928 00000100:00100000:1.0:1788970002.703637:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 105 00000100:00100000:1.0:1788970002.703650:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878929e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+51:10527:x1875870732044928:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:1.0:1788970002.703784:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970002.703841:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9fb expref: 51 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.703866:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970002.703882:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970002.704457:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.704476:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.704486:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.704532:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.704550:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 51 pid: 5832 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.704567:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff22580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741494272:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970002.704690:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788970002.706733:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.707191:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732044672 00000100:00100000:1.0:1788970002.707203:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732044672 00010000:00010000:1.0:1788970002.707255:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 52 pid: 5832 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.707309:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:1.0:1788970002.707335:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+52:2354:x1875870732044672:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970002.707354:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970002.707362:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 52 pid: 5832 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.707446:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 52 pid: 5832 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.707482:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970002.707488:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.707498:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.707506:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.707531:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970002.707610:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+52:2354:x1875870732044672:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 275us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970002.707617:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00010000:00010000:1.0:1788970002.710664:0:5834:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.9@tcp) returned -22 from blocking AST (req@000000002a811750 x1875870741494272) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 51 pid: 5832 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.710696:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea02 expref: 51 pid: 5832 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.710741:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff22580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741494272:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970002.710884:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970002.710897:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.710909:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.710917:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970002.711623:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788970002.711700:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004b3d4fe reply state 000000002eff7262 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.711712:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970002.712229:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878929e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+52:10527:x1875870732044928:12345-192.168.202.9@tcp:36:bash.0 Request processed in 8578us (8830us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788970002.712239:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 105 00000020:00080000:1.0:1788970002.712247:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788970002.714784:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.714844:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.714853:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.714894:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970002.714899:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.714909:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.715083:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970002.715088:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970002.715094:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.715102:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b429f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970002.717261:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970002.717680:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732045056 00000100:00100000:0.0:1788970002.717693:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732045056 00000100:00100000:0.0:1788970002.717778:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 106 00000100:00100000:0.0:1788970002.717828:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+51:10527:x1875870732045056:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970002.717862:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970002.717900:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b42a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea09 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.718223:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.718237:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.718247:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970002.718276:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788970002.718281:0:7061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970002.718317:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.718343:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b42a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea09 expref: 53 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.718359:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea09 expref: 52 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.718376:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:2.0:1788970002.718380:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970002.718384:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d200, rc 0) 00000100:00100000:2.0:1788970002.718472:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+52:10527:x1875870732045056:12345-192.168.202.9@tcp:101:bash.0 Request processed in 679us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970002.718478:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 106 00000100:00100000:2.0:1788970002.723780:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.723925:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732045312 00000100:00100000:1.0:1788970002.723946:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732045312 00000100:00100000:1.0:1788970002.724005:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:1.0:1788970002.724014:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+52:10527:x1875870732045312:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:1.0:1788970002.724683:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+53:10527:x1875870732045312:12345-192.168.202.9@tcp:35:bash.0 Request processed in 666us (912us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788970002.724694:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:0.0:1788970002.832109:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970002.832316:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732045440 00000100:00100000:3.0:1788970002.832330:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732045440 00000100:00100000:3.0:1788970002.832478:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 107 00000100:00100000:3.0:1788970002.832492:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+53:10533:x1875870732045440:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970002.832528:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970002.832558:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b42b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea10 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.832664:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b42bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.832684:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b42bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.832698:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b42bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970002.832742:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788970002.832747:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970002.832771:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b42bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.832841:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b42b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea10 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.832892:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b42bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea10 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.832901:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:3.0:1788970002.832905:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970002.832909:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dde00, rc 0) 00000100:00100000:3.0:1788970002.833181:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:10533:x1875870732045440:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 690us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970002.833189:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 107 00000100:00100000:3.0:1788970002.835866:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.836232:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732045568 00000100:00100000:1.0:1788970002.836245:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732045568 00000100:00100000:1.0:1788970002.836343:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 108 00000100:00100000:1.0:1788970002.836352:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:10533:x1875870732045568:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970002.836387:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970002.836437:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b42c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea17 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.836530:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.836548:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.836565:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.836582:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.836589:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.836596:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837072:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b42d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837085:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837093:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970002.837142:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788970002.837147:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970002.837171:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837197:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837207:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837215:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837222:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837229:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970002.837234:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837244:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837258:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:1.0:1788970002.837262:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970002.837269:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837276:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b42c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837290:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837297:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837311:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837317:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970002.837320:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837327:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837335:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9778519ab000) 00010000:00010000:1.0:1788970002.837338:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970002.837341:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837347:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837401:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b42c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea17 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837417:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b42d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea17 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.837424:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970002.837427:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970002.837429:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92e00, rc 0) 00000100:00100000:1.0:1788970002.837510:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:10533:x1875870732045568:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1157us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970002.837530:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 108 00000100:00100000:2.0:1788970002.849299:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970002.849420:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732045696 00000100:00100000:0.0:1788970002.849435:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732045696 00000100:00100000:0.0:1788970002.849528:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970002.849540:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:2355:x1875870732045696:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970002.849560:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970002.849592:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b42d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea17 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.849614:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:0.0:1788970002.849637:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970002.849716:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:2355:x1875870732045696:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 177us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970002.849725:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970002.852687:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970002.852832:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732045952 00000100:00100000:1.0:1788970002.852845:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732045952 00000100:00100000:1.0:1788970002.852924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:1.0:1788970002.852943:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:10533:x1875870732045952:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970002.852971:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970002.852998:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b42de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.853134:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.853152:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea09 expref: 55 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.853162:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.853204:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea09 expref: 55 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.853220:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea09 expref: 55 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.853236:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff22580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741494400:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970002.853357:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788970002.857214:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970002.857515:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732046080 00000100:00100000:3.0:1788970002.857529:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732046080 00010000:00010000:3.0:1788970002.857586:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea09 expref: 56 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970002.857638:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:3.0:1788970002.857650:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:2353:x1875870732046080:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970002.857671:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970002.857680:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea09 expref: 56 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.857697:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea09 expref: 56 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.857726:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:3.0:1788970002.857749:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.857773:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.857783:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970002.857854:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970002.858453:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b42ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea09 expref: 56 pid: 7061 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970002.858497:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff22580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741494400:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970002.858529:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.858540:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.858546:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970002.858572:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788970002.858828:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b42de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea1e expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.858847:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea1e expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970002.858856:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970002.858859:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970002.858862:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93400, rc 0) 00000100:00100000:1.0:1788970002.859608:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10533:x1875870732045952:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 6668us (6928us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788970002.859621:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:3.0:1788970002.864029:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970002.864268:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732046336 00000100:00100000:0.0:1788970002.864284:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732046336 00000100:00100000:0.0:1788970002.864380:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:0.0:1788970002.864394:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851af0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10533:x1875870732046336:12345-192.168.202.9@tcp:103:lfs.0 00010000:00010000:0.0:1788970002.864416:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970002.864450:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4244 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9f4 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.864489:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:0.0:1788970002.864496:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970002.864567:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851af0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:10533:x1875870732046336:12345-192.168.202.9@tcp:103:lfs.0 Request processed in 176us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970002.864576:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788970002.866218:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:2353:x1875870732046080:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 8555us (9003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970002.866233:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:3.0:1788970002.878674:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970002.879315:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732046464 00000100:00100000:2.0:1788970002.879330:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732046464 00000100:00100000:2.0:1788970002.879430:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00100000:2.0:1788970002.879443:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:10533:x1875870732046464:12345-192.168.202.9@tcp:58:lfs.0 00010000:00010000:2.0:1788970002.879633:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.879658:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970002.879683:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970002.881123:0:7061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788970002.881279:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:10533:x1875870732046464:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 1831us (2618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970002.881292:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00100000:3.0:1788970002.884524:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970002.884780:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732046592 00000100:00100000:0.0:1788970002.884830:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732046592 00000100:00100000:0.0:1788970002.884905:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 111 00000100:00100000:0.0:1788970002.884915:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878928b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:10533:x1875870732046592:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970002.884952:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970002.884979:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484200/0x5d0de860b05b42fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea25 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.885071:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.885105:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484200/0x5d0de860b05b42fa lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea25 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.885129:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.885145:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484200/0x5d0de860b05b42fa lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea25 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.885164:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:0.0:1788970002.885167:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970002.885170:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484200/0x5d0de860b05b42fa lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea25 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970002.885178:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484200, rc 0) 00000100:00100000:0.0:1788970002.885258:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878928b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:10533:x1875870732046592:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 343us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970002.885264:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 111 00000040:00080000:3.0:1788970003.207183:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970003.207196:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970003.207249:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788970003.207258:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970003.207458:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787892a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741494528:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788970003.209224:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970003.222652:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.222894:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732046720 00000100:00100000:1.0:1788970003.222912:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732046720 00000100:00100000:1.0:1788970003.222973:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 112 00000100:00100000:1.0:1788970003.222984:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10534:x1875870732046720:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788970003.223037:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788970003.223142:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10534:x1875870732046720:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 160us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.223150:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 112 00000100:00100000:0.0:1788970003.223510:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787892a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741494528:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788970003.231619:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970003.231716:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732046848 00000100:00100000:3.0:1788970003.231726:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732046848 00000100:00100000:3.0:1788970003.231814:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:3.0:1788970003.231825:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:10534:x1875870732046848:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788970003.232188:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232206:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232237:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232312:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232321:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232328:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232481:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232493:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232500:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970003.232540:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788970003.232544:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970003.232556:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232567:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232574:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232592:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232598:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970003.232603:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232611:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232623:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:3.0:1788970003.232626:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970003.232631:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232638:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4301 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232654:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232661:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232667:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232673:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970003.232675:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232690:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232709:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff977858b3c600) 00010000:00010000:3.0:1788970003.232712:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970003.232715:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232721:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4308 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232736:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232743:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232749:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232753:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970003.232755:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232761:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.232767:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:3.0:1788970003.232769:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970003.232772:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.233228:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b430f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.233411:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:10534:x1875870732046848:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 1585us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970003.233420:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:2.0:1788970003.240687:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.241355:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732047104 00000100:00100000:1.0:1788970003.241375:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732047104 00000100:00100000:1.0:1788970003.241438:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:1.0:1788970003.241449:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:10534:x1875870732047104:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970003.241470:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970003.241491:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4316 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea2c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.241593:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.241609:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.241619:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970003.241631:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788970003.242301:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.242311:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.242318:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.242676:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970003.242682:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.242691:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.242786:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970003.242815:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788970003.242821:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.242829:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b431d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.243276:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4316 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea2c expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.243289:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:1.0:1788970003.243292:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970003.243296:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4316 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea2c expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.243307:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93a00, rc 0) 00000100:00100000:1.0:1788970003.243462:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10534:x1875870732047104:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 2013us (2782us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788970003.243473:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:3.0:1788970003.277139:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.279476:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732047232 00000100:00100000:1.0:1788970003.279510:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732047232 00000100:00100000:1.0:1788970003.279592:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:1.0:1788970003.279605:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10534:x1875870732047232:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788970003.279655:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788970003.279779:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10534:x1875870732047232:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 176us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.279787:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:0.0:1788970003.292929:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.293040:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732047488 00000100:00100000:2.0:1788970003.293052:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732047488 00000100:00100000:2.0:1788970003.293121:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:2.0:1788970003.293131:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f465680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10534:x1875870732047488:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970003.293152:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970003.293156:0:7061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788970003.293182:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b42bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea10 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.293203:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:2.0:1788970003.293209:0:7061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970003.293222:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b432b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea33 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970003.293640:0:7061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788970003.294035:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.294059:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.294071:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.294127:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b432b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea33 expref: 58 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.294145:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea33 expref: 57 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.294152:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b400) 00010000:00010000:2.0:1788970003.294154:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970003.294158:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44dc00, rc 0) 00000100:00100000:2.0:1788970003.294220:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f465680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+57:10534:x1875870732047488:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1090us (1301us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788970003.294229:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:3.0:1788970003.301070:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.301164:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732047744 00000100:00100000:1.0:1788970003.301174:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732047744 00000100:00100000:1.0:1788970003.301223:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:1.0:1788970003.301231:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+57:10534:x1875870732047744:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970003.301282:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970003.301307:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea33 expref: 57 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301327:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b400) 00010000:00010000:1.0:1788970003.301337:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970003.301357:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301380:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301389:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301402:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301428:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301435:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301498:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301506:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301513:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301519:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970003.301523:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301530:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301537:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:1.0:1788970003.301540:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970003.301544:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301550:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4340 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301558:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301568:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301574:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301579:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970003.301582:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301588:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301594:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa463b84d (ffff9778519ab000) 00010000:00010000:1.0:1788970003.301596:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970003.301598:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.301603:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4347 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa463b84d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970003.301672:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10534:x1875870732047744:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 441us (610us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970003.301679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:3.0:1788970003.307583:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.307697:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732047872 00000100:00100000:2.0:1788970003.307707:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732047872 00000100:00100000:2.0:1788970003.307765:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:2.0:1788970003.307776:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:10534:x1875870732047872:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970003.307829:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970003.307850:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b434e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea3a expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.307905:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.307933:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.307945:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.308041:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b434e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea3a expref: 58 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.308059:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea3a expref: 57 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.308068:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:2.0:1788970003.308071:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970003.308074:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44ca00, rc 0) 00000100:00100000:2.0:1788970003.308137:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+57:10534:x1875870732047872:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 363us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970003.308145:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:0.0:1788970003.313601:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.313693:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732048128 00000100:00100000:2.0:1788970003.313704:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732048128 00000100:00100000:2.0:1788970003.313769:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:2.0:1788970003.313779:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+57:10534:x1875870732048128:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970003.314595:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.314614:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.314647:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970003.315098:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788970003.315109:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315278319237ns, next at 316278316089ns, rc = 0 00000004:00010000:2.0:1788970003.315203:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005282cb7f reply state 000000009c12c71e transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.315212:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970003.315386:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:10534:x1875870732048128:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 1605us (1792us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788970003.315395:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:3.0:1788970003.327540:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1788970003.327665:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.327680:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.327689:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.327696:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44dc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970003.327702:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.327710:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.327726:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:2.0:1788970003.327730:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788970003.327744:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.327751:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b435c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970003.332595:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732048256 00000100:00100000:0.0:1788970003.332611:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732048256 00000100:00100000:0.0:1788970003.332722:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:0.0:1788970003.332733:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+58:10534:x1875870732048256:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970003.332778:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970003.332822:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea41 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.334559:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea41 expref: 59 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.334591:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea41 expref: 59 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.334630:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:0.0:1788970003.334633:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970003.334636:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485400, rc 0) 00000100:00100000:0.0:1788970003.334723:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:10534:x1875870732048256:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1991us (7193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970003.334731:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 120 00000100:00100000:3.0:1788970003.340872:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.341438:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732048384 00000100:00100000:2.0:1788970003.341448:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732048384 00000100:00100000:2.0:1788970003.341525:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:2.0:1788970003.341534:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732048384:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788970003.342087:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970003.344150:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2353:x1875870732048384:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 2605us (3287us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788970003.344164:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:2.0:1788970003.352576:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.353323:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732048640 00000100:00100000:1.0:1788970003.353335:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732048640 00000100:00100000:1.0:1788970003.353411:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:1.0:1788970003.353423:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:10534:x1875870732048640:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788970003.353693:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:10534:x1875870732048640:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 272us (1127us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788970003.353701:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:0.0:1788970003.367099:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.367275:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732048896 00000100:00100000:1.0:1788970003.367286:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732048896 00000100:00100000:1.0:1788970003.367354:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 121 00000100:00100000:1.0:1788970003.367373:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:10534:x1875870732048896:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788970003.367492:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:10534:x1875870732048896:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 128us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.367500:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 121 00000100:00100000:3.0:1788970003.370244:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.370514:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732049024 00000100:00100000:1.0:1788970003.370525:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732049024 00000100:00100000:1.0:1788970003.370645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:1.0:1788970003.370657:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:10534:x1875870732049024:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970003.370679:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970003.370701:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b436a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea48 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.370838:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4371 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.370854:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.370865:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970003.370932:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970003.370950:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.370975:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b436a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea48 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.370993:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea48 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.371002:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:1.0:1788970003.371005:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788970003.371008:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93a00, rc 0) 00000100:00100000:1.0:1788970003.371063:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:10534:x1875870732049024:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 408us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.371070:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:0.0:1788970003.380246:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.381156:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732049152 00000100:00100000:1.0:1788970003.381168:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732049152 00000100:00100000:1.0:1788970003.381241:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:1.0:1788970003.381253:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2353:x1875870732049152:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970003.381273:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970003.381300:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea4f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970003.381329:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa18413, blocks: 0x1 00010000:00010000:1.0:1788970003.381349:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1788970003.381380:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970003.381390:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea4f expref: 10 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.381410:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea4f expref: 10 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.381424:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92200, rc 0) 00000100:00100000:1.0:1788970003.381485:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:2353:x1875870732049152:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 234us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.381492:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:2.0:1788970003.387939:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.391640:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732049408 00000100:00100000:1.0:1788970003.391657:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732049408 00000100:00100000:1.0:1788970003.391734:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00100000:1.0:1788970003.391745:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:10534:x1875870732049408:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788970003.391868:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:10534:x1875870732049408:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 124us (3954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.391876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 123 00000100:00100000:3.0:1788970003.399912:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.401100:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732049536 00000100:00100000:2.0:1788970003.401119:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732049536 00000100:00100000:2.0:1788970003.401453:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:2.0:1788970003.401469:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:10534:x1875870732049536:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970003.401496:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970003.401523:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea56 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.401589:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea4f expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.401601:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970003.401607:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970003.401630:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.401674:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea4f expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.401691:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea4f expref: 11 pid: 6676 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.401708:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1875870741494656:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970003.401857:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970003.406273:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1875870741494656:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970003.406325:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.406353:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d200, rc 0) 00000100:00100000:2.0:1788970003.406452:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:10534:x1875870732049536:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 4987us (6557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970003.406462:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:2.0:1788970003.410085:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970003.410190:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732049664 00000100:00100000:0.0:1788970003.410201:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732049664 00010000:00010000:0.0:1788970003.410242:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea4f expref: 11 pid: 6676 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970003.410290:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:0.0:1788970003.410299:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:2353:x1875870732049664:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970003.410314:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970003.410355:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea4f expref: 11 pid: 6676 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.410379:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea4f expref: 11 pid: 6676 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.410402:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4378 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea4f expref: 11 pid: 6676 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.410420:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970003.410425:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970003.410434:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.410443:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.410482:0:11142:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970003.410496:0:11142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f4652c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11142:1875870741494784:192.168.202.9@tcp:105: 00000100:00100000:0.0:1788970003.410591:0:11142:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970003.419049:0:11142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f4652c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11142:1875870741494784:192.168.202.9@tcp:105: 00010000:00010000:0.0:1788970003.419074:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970003.419125:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:2353:x1875870732049664:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 8828us (9051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970003.419156:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:2.0:1788970003.422614:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970003.422708:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732049792 00000100:00100000:3.0:1788970003.422718:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732049792 00002000:00100000:3.0:1788970003.422775:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97787dce4f00 x1875870732049792/t0(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:534/0 lens 504/0 e 0 to 0 dl 1788970014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970003.422786:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787dce4f00 with x1875870732049792 ext(0->12) 00002000:00010000:3.0:1788970003.423083:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787dce4f00 00000100:00100000:3.0:1788970003.423116:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:3.0:1788970003.423128:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:2353:x1875870732049792:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788970003.423661:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:2353:x1875870732049792:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 Request processed in 533us (1054us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788970003.423670:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00002000:00100000:3.0:1788970003.423677:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97787dce4f00 x1875870732049792/t4294967308(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:534/0 lens 504/448 e 0 to 0 dl 1788970014 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970003.423686:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787dce4f00 with x1875870732049792 ext(0->12) 00002000:00010000:3.0:1788970003.423690:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787dce4f00 00000100:00100000:2.0:1788970003.428447:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970003.428549:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732049920 00000100:00100000:0.0:1788970003.428560:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732049920 00000100:00100000:0.0:1788970003.428625:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:0.0:1788970003.428636:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:10534:x1875870732049920:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788970003.499331:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967390 is committed 00000001:00080000:1.0:1788970003.499396:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788970003.499419:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788970003.499436:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff977847233840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788970003.499440:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97787a6e9800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff977847233cc0 00000020:00080000:1.0:1788970003.499444:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97787a6e9200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff977865040800 00000020:00080000:1.0:1788970003.499580:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788970003.499610:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741494912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788970003.499676:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970003.499755:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741494912 00000100:00100000:1.0:1788970003.499763:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741494912 00000100:00100000:1.0:1788970003.499850:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788970003.499859:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3284:x1875870741494912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788970003.499895:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1788970003.500377:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa18412, atime: 0x6aa18412, ctime: 0x6aa18412, blocks: 0x1 00010000:00010000:1.0:1788970003.500388:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.500404:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1788970003.500409:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970003.500414:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.500430:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.500439:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.500447:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.500471:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788970003.501424:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3284:x1875870741494912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1562us (1743us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788970003.501441:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788970003.501598:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:10534:x1875870732049920:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 72962us (73161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.501606:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 124 00010000:00010000:2.0:1788970003.501776:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970003.501784:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.501839:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970003.501844:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.501854:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.501875:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.501883:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4386 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.501904:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970003.501906:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970003.501908:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788970003.501968:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788970003.501995:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788970003.502013:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff977850e166c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788970003.502017:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977845373500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff977850e16300 00000020:00080000:0.0:1788970003.502021:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977845373900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff977851aaa800 00000020:00080000:2.0:1788970003.502137:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788970003.502264:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1788970003.503533:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97787ff22580/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788970003.503543:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741494912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788970003.503603:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741495040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788970003.503657:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970003.503700:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970003.503706:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741495168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788970003.503732:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970003.503815:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741495040 00000100:00100000:3.0:1788970003.503822:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741495040 00000100:00100000:3.0:1788970003.503883:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741495168 00000100:00100000:3.0:1788970003.503887:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741495168 00000100:00100000:3.0:1788970003.503904:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970003.503912:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741495040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788970003.503941:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1788970003.503965:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.503985:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9b5 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.503995:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788970003.503999:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970003.504004:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.504029:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9b5 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.504044:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9b5 expref: 11 pid: 6679 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970003.504055:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787929de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1875870741495296:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970003.504118:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff977845391a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970003.504519:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788970003.504529:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741495168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788970003.504667:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788970003.504671:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788970003 00002000:00010000:1.0:1788970003.504674:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788970003.504676:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788970003 -> 1788970003 00002000:00010000:1.0:1788970003.504678:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788970003.504726:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3285:x1875870741495168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 199us (992us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788970003.504733:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788970003.504967:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788970003.505214:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97787ff21680/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788970003.505220:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741495168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788970003.508315:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.512242:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732050048 00000100:00100000:2.0:1788970003.512276:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732050048 00000100:00100000:2.0:1788970003.512335:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:2.0:1788970003.512345:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:2356:x1875870732050048:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788970003.513991:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787929de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1875870741495296:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970003.514021:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970003.517088:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970003.517161:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732050176 00000100:00100000:3.0:1788970003.517170:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732050176 00010000:00010000:3.0:1788970003.517208:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9b5 expref: 13 pid: 6679 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970003.517248:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1788970003.517258:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2353:x1875870732050176:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970003.517271:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970003.517277:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9b5 expref: 13 pid: 6679 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.517289:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9b5 expref: 13 pid: 6679 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.517311:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bd15b50/0x5d0de860b05b4148 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e9b5 expref: 13 pid: 6679 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.517328:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970003.517346:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970003.517352:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.517373:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.517400:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970003.517447:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:2353:x1875870732050176:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 190us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970003.517455:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00010000:00010000:3.0:1788970003.517480:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.517490:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.517500:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.517508:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.517524:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788970003.518115:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3285:x1875870741495040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14202us (14456us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788970003.518125:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788970003.518155:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970003.518162:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.518169:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970003.518173:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.518182:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.518195:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.518203:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b438d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.518220:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970003.518222:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970003.518223:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788970003.518274:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97787ff20f00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788970003.518281:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741495040:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788970003.524951:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788970003.553620:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788970003.553640:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788970003.553649:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788970003.553857:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2356:x1875870732050048:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 41506us (45545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.553878:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:1.0:1788970003.558028:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970003.558130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732050432 00000100:00100000:0.0:1788970003.558141:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732050432 00000100:00100000:0.0:1788970003.558240:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 125 00000100:00100000:0.0:1788970003.558251:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:10534:x1875870732050432:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788970003.558315:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970003.558343:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b4371 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea48 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.558372:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:0.0:1788970003.558378:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970003.558410:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.558443:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.558453:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970003.558698:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d79f750b reply state 000000007aea2b71 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970003.558709:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970003.558910:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:10534:x1875870732050432:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 659us (889us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788970003.558918:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 125 00010000:00010000:1.0:1788970003.560985:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.561002:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.561032:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.561038:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970003.561044:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.561053:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.561068:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:1.0:1788970003.561072:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970003.561077:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.561083:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970003.561742:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.562399:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732050560 00000100:00100000:2.0:1788970003.562409:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732050560 00000100:00100000:2.0:1788970003.562465:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:2.0:1788970003.562475:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732050560:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788970003.562686:0:8534:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788970003.562690:0:8534:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788970003 -> 1788970003 00002000:00010000:2.0:1788970003.562693:0:8534:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788970002 00002000:00010000:2.0:1788970003.562695:0:8534:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788970003 -> 1788970003 00002000:00010000:2.0:1788970003.562698:0:8534:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788970003.563383:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732050560:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 905us (1642us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788970003.563393:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:1.0:1788970003.566563:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.566644:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732050816 00000100:00100000:2.0:1788970003.566656:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732050816 00000100:00100000:2.0:1788970003.566742:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:2.0:1788970003.566752:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:10534:x1875870732050816:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788970003.566882:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.566899:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea3a expref: 15 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.566908:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.566970:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea3a expref: 15 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.566985:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea3a expref: 15 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.566999:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741495424:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970003.567087:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970003.569731:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741495424:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970003.569771:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970003.572211:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970003.572676:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732050944 00000100:00100000:3.0:1788970003.572685:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732050944 00010000:00010000:3.0:1788970003.572731:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea3a expref: 16 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970003.572840:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:3.0:1788970003.572850:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:2354:x1875870732050944:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970003.572871:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970003.572879:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea3a expref: 16 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.572892:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea3a expref: 16 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.572915:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b4355 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea3a expref: 16 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.572942:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:3.0:1788970003.572947:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.572955:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.572963:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.572984:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970003.573053:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:2354:x1875870732050944:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 204us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970003.573061:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00010000:00010000:1.0:1788970003.573916:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.573935:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.573979:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.573986:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.573991:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.573997:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970003.574001:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.574008:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.574021:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:1.0:1788970003.574024:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788970003.574028:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.574033:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b439b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970003.574146:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10534:x1875870732050816:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 Request processed in 7394us (7592us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788970003.574155:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:1.0:1788970003.577529:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970003.577667:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732051072 00000100:00100000:3.0:1788970003.577697:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732051072 00000100:00100000:3.0:1788970003.577757:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:3.0:1788970003.577768:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977861e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732051072:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788970003.577861:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.577892:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.577901:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970003.577904:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970003.577909:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.577950:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.577966:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 7 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970003.577980:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787929c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1875870741495552:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970003.578060:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778455020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970003.581479:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787929c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1875870741495552:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970003.581512:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970003.582249:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970003.582560:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732051200 00000100:00100000:3.0:1788970003.582569:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732051200 00010000:00010000:3.0:1788970003.582611:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 8 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970003.582676:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:3.0:1788970003.582685:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732051200:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970003.582702:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970003.582725:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 8 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.582740:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 8 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.582761:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b437f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea56 expref: 8 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.582777:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970003.582781:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970003.583225:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.583239:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.584176:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970003.584255:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732051200:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1565us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970003.584265:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 57 00010000:00010000:3.0:1788970003.585610:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.585628:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.585683:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.585692:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.585702:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.585710:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970003.585714:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.585724:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.585743:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970003.585751:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc35c12f/0x5d0de860b05b43a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.586222:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977861e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732051072:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 8451us (8698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970003.586233:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:1.0:1788970003.593398:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.593494:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732051456 00000100:00100000:2.0:1788970003.593504:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732051456 00000100:00100000:2.0:1788970003.593560:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 127 00000100:00100000:2.0:1788970003.593571:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10534:x1875870732051456:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788970003.593649:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.593669:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.593682:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.594150:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.594163:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea41 expref: 15 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.594178:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.594209:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea41 expref: 15 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.594225:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea41 expref: 15 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.594239:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741495680:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970003.594315:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970003.597091:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970003.597385:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732051584 00000100:00100000:0.0:1788970003.597395:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732051584 00010000:00010000:0.0:1788970003.597432:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea41 expref: 16 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970003.597467:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:0.0:1788970003.597477:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:2354:x1875870732051584:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970003.597510:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970003.597517:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea41 expref: 16 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.597531:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea41 expref: 16 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.597552:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:0.0:1788970003.597558:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.597567:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.597575:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.597593:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970003.597649:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:2354:x1875870732051584:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 173us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970003.597657:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00010000:00010000:2.0:1788970003.598137:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b4363 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea41 expref: 15 pid: 7061 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.598155:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741495680:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970003.598174:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.598183:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.598189:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970003.598381:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788970003.598524:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788970003.598567:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788970003.598655:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875870741495808:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788970003.598700:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970003.598736:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970003.599806:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741495808 00000100:00100000:3.0:1788970003.599816:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741495808 00000100:00100000:3.0:1788970003.599889:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970003.599898:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875870741495808:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788970003.600126:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875870741495808:12345-0@lo:1000:mdt00_001.0 Request processed in 228us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970003.600134:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970003.601249:0:5833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788970003.601258:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788970003.601277:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97787ff21680, transno 4294967309 00000100:00100000:2.0:1788970003.601297:0:5833:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff97787ff20f00 x1875870741495040/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788970019 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970003.601309:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875870741495808:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788970003.601847:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788970003.603884:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875870741495936:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788970003.603961:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970003.603990:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787359d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970003.604065:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741495936 00000100:00100000:3.0:1788970003.604073:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741495936 00000100:00100000:3.0:1788970003.604116:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970003.604124:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875870741495936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788970003.604306:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1875870741495936:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (343us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788970003.604314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970003.605838:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875870741495936:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788970003.605896:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.605906:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.605914:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.605919:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970003.606093:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606103:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606136:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977843e0b500) 00010000:00010000:2.0:1788970003.606139:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970003.606144:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606151:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b43b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606184:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606191:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606196:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606201:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44cc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970003.606204:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606209:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606217:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:2.0:1788970003.606219:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970003.606226:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484200/0x5d0de860b05b42fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea25 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606238:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484200/0x5d0de860b05b42fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea25 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606256:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484200/0x5d0de860b05b42fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea25 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.606306:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484200/0x5d0de860b05b42fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea25 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.606321:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f3d9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741496064:192.168.202.9@tcp:105: 00000100:00100000:2.0:1788970003.606414:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970003.609566:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f3d9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741496064:192.168.202.9@tcp:105: 00010000:00010000:2.0:1788970003.609596:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609609:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b42f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609645:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609660:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609672:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609682:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609688:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609711:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609717:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970003.609721:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609728:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609740:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:2.0:1788970003.609743:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970003.609747:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609753:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b43b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609762:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609768:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609773:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609778:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970003.609781:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609840:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609849:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:2.0:1788970003.609851:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970003.609855:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.609861:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b43a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.610098:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:10534:x1875870732051456:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 16527us (16708us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788970003.610108:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 127 00000020:00080000:2.0:1788970003.610114:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788970003.610688:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970003.610694:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970003.611258:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788970003.611268:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788970003.615042:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.615138:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.615287:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732051712 00000100:00100000:2.0:1788970003.615298:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732051712 00000100:00100000:2.0:1788970003.615340:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732051968 00000100:00100000:2.0:1788970003.615343:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732051968 00000100:00100000:2.0:1788970003.615366:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:2.0:1788970003.615377:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10533:x1875870732051712:12345-192.168.202.9@tcp:49:lfs.0 00000100:00100000:2.0:1788970003.615512:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:10533:x1875870732051712:12345-192.168.202.9@tcp:49:lfs.0 Request processed in 135us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970003.615519:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:2.0:1788970003.615535:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:2.0:1788970003.615541:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:10534:x1875870732051968:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788970003.616218:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788970003.616324:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788970003.616384:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.616400:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.616412:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.616421:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.616428:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.616434:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.616452:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788970003.616513:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:10534:x1875870732051968:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 970us (1374us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788970003.616520:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 32 00000020:00080000:2.0:1788970003.616525:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788970003.616674:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970003.616681:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.616689:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44ca00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970003.616693:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.616701:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.616713:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff977851ac1800) 00010000:00010000:1.0:1788970003.616716:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788970003.616720:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.616726:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b43be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.616744:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970003.616746:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970003.616747:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970003.621048:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970003.621113:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732052224 00000100:00100000:1.0:1788970003.621123:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732052224 00000100:00100000:1.0:1788970003.621180:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 128 00000100:00100000:1.0:1788970003.621190:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:10533:x1875870732052224:12345-192.168.202.9@tcp:58:lfs.0 00000040:00080000:1.0:1788970003.621465:0:7061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788970003.621542:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:10533:x1875870732052224:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 352us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.621568:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 128 00000100:00100000:2.0:1788970003.676224:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970003.676332:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732052352 00000100:00100000:0.0:1788970003.676344:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732052352 00000100:00100000:0.0:1788970003.676449:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 129 00000100:00100000:0.0:1788970003.676463:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:10536:x1875870732052352:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970003.676493:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970003.676519:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b43c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea5d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.676620:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.676636:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.676648:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.676662:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.676669:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.676675:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.677179:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.677192:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea1e expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.677201:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.677235:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea1e expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970003.677261:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea1e expref: 21 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970003.677276:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f4652c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741496192:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970003.677377:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788970003.682264:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.682451:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732052608 00000100:00100000:2.0:1788970003.682466:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732052608 00000100:00100000:2.0:1788970003.682541:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:2.0:1788970003.682551:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:5596:x1875870732052608:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788970003.682871:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:5596:x1875870732052608:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 311us (607us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788970003.682896:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:1.0:1788970003.683317:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f4652c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741496192:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970003.683346:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970003.686662:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970003.687187:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732052736 00000100:00100000:2.0:1788970003.687199:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732052736 00010000:00010000:2.0:1788970003.687241:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea1e expref: 23 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970003.687286:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:2.0:1788970003.687296:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:2354:x1875870732052736:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970003.687313:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970003.687321:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea1e expref: 23 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.687335:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea1e expref: 23 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.687369:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b42e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea1e expref: 23 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.687387:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:2.0:1788970003.687393:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.687402:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.687409:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970003.687461:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970003.687527:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:2354:x1875870732052736:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 232us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970003.687535:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00010000:00010000:1.0:1788970003.687605:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687613:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970003.687661:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788970003.687666:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970003.687683:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687696:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687708:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687714:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687721:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687727:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970003.687731:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687748:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687769:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:1.0:1788970003.687772:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970003.687776:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687782:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b43cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687848:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687855:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687870:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687876:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970003.687879:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687885:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.687893:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff977849672900) 00010000:00010000:1.0:1788970003.687895:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970003.687898:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.688222:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b43d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.688261:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b43c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea5d expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.688275:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea5d expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970003.688283:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970003.688286:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970003.688288:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484000, rc 0) 00000100:00100000:1.0:1788970003.688320:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10536:x1875870732052352:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 11862us (12107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970003.688328:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 129 00000100:00100000:2.0:1788970003.913444:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970003.913468:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741496320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970003.913536:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970003.919147:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741496320 00000100:00100000:0.0:1788970003.919167:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741496320 00000100:00100000:0.0:1788970003.919232:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788970003.919241:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3284:x1875870741496320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970003.919265:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970003.919353:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3284:x1875870741496320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (5815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970003.919377:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788970003.919442:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741496320:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788970004.069539:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1788970004.069564:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:0.0:1788970004.541119:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970004.541167:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970004.541199:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970004.541218:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970004.541252:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970004.541300:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732052864 00000100:00100000:3.0:1788970004.541312:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732052864 00000100:00100000:3.0:1788970004.541380:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 284 00000100:00100000:3.0:1788970004.541391:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732052864:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970004.541462:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732052864:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 73us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970004.541469:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 284 00000100:00100000:0.0:1788970004.545685:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732053376 00000100:00100000:0.0:1788970004.546076:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732053376 00000100:00080000:3.0:1788970004.546141:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970004.546154:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732052992 00000100:00100000:0.0:1788970004.546171:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732052992 00000100:00080000:3.0:1788970004.546214:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970004.546231:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 127 00000100:00100000:0.0:1788970004.546242:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f465a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732053376:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970004.546328:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f465a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732053376:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 87us (5128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970004.546336:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 127 00000100:00100000:0.0:1788970004.546364:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 128 00000100:00100000:0.0:1788970004.546373:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:2353:x1875870732052992:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970004.546402:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:2353:x1875870732052992:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 31us (5184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970004.546408:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 128 00000100:00100000:1.0:1788970004.552471:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732053120 00000100:00100000:1.0:1788970004.552491:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732053120 00000100:00080000:1.0:1788970004.552545:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970004.552596:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732053248 00000100:00100000:1.0:1788970004.552599:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732053248 00000100:00100000:1.0:1788970004.552643:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:1.0:1788970004.552654:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732053120:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970004.552741:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732053120:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 88us (11572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970004.552748:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:1.0:1788970004.552766:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:1.0:1788970004.552772:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732053248:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970004.552831:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732053248:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 59us (11578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970004.552838:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00010000:00010000:1.0:1788970004.560287:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970004.610193:0:12024:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970004.610204:0:12024:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970004.610253:0:12024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788970004.610259:0:12024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788970004.613287:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970004.613297:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970004.613369:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788970004.613376:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788970004.613512:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741496448:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788970004.613625:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970004.624226:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741496448:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788970004.634710:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970004.634838:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732053504 00000100:00100000:2.0:1788970004.634854:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732053504 00000100:00100000:2.0:1788970004.634937:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00100000:2.0:1788970004.634947:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10548:x1875870732053504:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788970004.634980:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788970004.635099:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10548:x1875870732053504:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 153us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970004.635107:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00100000:1.0:1788970004.646434:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970004.646516:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732053760 00000100:00100000:3.0:1788970004.646542:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732053760 00000100:00100000:3.0:1788970004.646602:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 131 00000100:00100000:3.0:1788970004.646611:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:10548:x1875870732053760:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970004.646631:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970004.646780:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b43e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea64 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.647201:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b43e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.647216:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b43e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.647228:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b43e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970004.647240:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788970004.647389:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b43e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea64 expref: 24 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.647411:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b43e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea64 expref: 23 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.647421:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:3.0:1788970004.647424:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970004.647428:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc600, rc 0) 00000100:00100000:3.0:1788970004.647531:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:10548:x1875870732053760:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 921us (1106us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788970004.647540:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 131 00000100:00100000:1.0:1788970004.654735:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970004.654805:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970004.654813:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732054016 00000100:00100000:3.0:1788970004.654823:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732054016 00000100:00100000:1.0:1788970004.654831:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732054144 00000100:00100000:1.0:1788970004.654834:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732054144 00000100:00100000:3.0:1788970004.654876:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 132 00000100:00100000:1.0:1788970004.654885:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1788970004.654891:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:2355:x1875870732054144:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788970004.654900:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:10548:x1875870732054016:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788970004.654908:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970004.654933:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b43e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea64 expref: 24 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970004.654955:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970004.654960:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970004.655014:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:2355:x1875870732054144:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 123us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970004.655021:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00010000:00010000:3.0:1788970004.655123:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.655139:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.655150:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.655398:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.655406:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.655412:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.655418:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970004.655423:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.655431:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.655439:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:3.0:1788970004.655441:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788970004.655463:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970004.655469:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b43f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970004.655602:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:10548:x1875870732054016:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 717us (877us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788970004.655610:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 132 00000040:00080000:1.0:1788970004.655732:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788970004.655737:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970004.656397:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788970004.656406:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788970004.661710:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970004.662148:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732054400 00000100:00100000:2.0:1788970004.662159:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732054400 00000100:00100000:2.0:1788970004.662216:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:2.0:1788970004.662232:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:10548:x1875870732054400:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788970004.662463:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:10548:x1875870732054400:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 232us (763us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788970004.662471:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:0.0:1788970004.933059:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741496576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970004.933140:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970004.933203:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741496576 00000100:00100000:2.0:1788970004.933212:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741496576 00000100:00100000:2.0:1788970004.933310:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788970004.933320:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875870741496576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970004.933343:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788970004.933434:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875870741496576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970004.933442:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788970004.933580:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741496576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970004.933720:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878948b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741496832:0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.933749:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741497088:0@lo:400:kworker.0 00000100:00100000:0.0:1788970004.933758:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970004.933783:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788970004.933813:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741496704:0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.933842:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970004.933862:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970004.933877:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970004.933899:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787894a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741496960:0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.933925:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970004.933951:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741496832 00000100:00100000:1.0:1788970004.933955:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741496832 00000100:00100000:1.0:1788970004.933980:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741496960 00000100:00100000:1.0:1788970004.933982:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741496960 00000100:00100000:0.0:1788970004.934010:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741497216:0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.934016:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788970004.934025:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741496832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.934060:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741496832:12345-0@lo:400:kworker.0 Request processed in 36us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970004.934067:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788970004.934084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788970004.934091:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741496960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970004.934109:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970004.934137:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741496960:12345-0@lo:400:kworker.0 Request processed in 46us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970004.934139:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878948b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741496832:0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.934146:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788970004.934166:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741497216 00000100:00100000:1.0:1788970004.934171:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741497216 00000100:00100000:1.0:1788970004.934193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788970004.934199:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741497216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.934236:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741497216:12345-0@lo:400:kworker.0 Request processed in 37us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970004.934242:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788970004.934267:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741497088 00000100:00100000:0.0:1788970004.934271:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741497216:0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.934273:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741497088 00000100:00100000:1.0:1788970004.934311:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788970004.934319:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741497088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.934364:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741497088:12345-0@lo:400:kworker.0 Request processed in 47us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970004.934370:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788970004.934389:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741496704 00000100:00100000:1.0:1788970004.934393:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741496704 00000100:00100000:1.0:1788970004.934423:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788970004.934430:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741496704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.934464:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3286:x1875870741496704:12345-0@lo:400:kworker.0 Request processed in 35us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970004.934471:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:1.0:1788970004.934501:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970004.934505:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970004.934524:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d87485c-d221-41b3-b6c0-56f4dfc97796:3286:1875870741496704:0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.934548:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787894a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741496960:0@lo:400:kworker.0 00000100:00100000:1.0:1788970004.934557:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788970004.934563:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1788970004.934579:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff977877fc92c0, transno 4294967301 00000004:00080000:1.0:1788970004.934596:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788970004.934607:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97787ff22580, transno 4294967304 00000100:00100000:1.0:1788970004.934612:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741497088:0@lo:400:kworker.0 00010000:00010000:1.0:1788970005.573057:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970006.563170:0:12075:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970006.563185:0:12075:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970006.563237:0:12075:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788970006.563245:0:12075:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788970006.599444:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970006.791669:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970006.791711:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732054656 00000100:00100000:1.0:1788970006.791733:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732054656 00000100:00100000:1.0:1788970006.791842:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 133 00000100:00100000:1.0:1788970006.791855:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:10569:x1875870732054656:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970006.791888:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970006.791915:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b43fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea6b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970006.792047:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b4404 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970006.792065:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b4404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970006.792079:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b4404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970006.792093:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788970006.792276:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b43fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea6b expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970006.792296:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b4404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea6b expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970006.792305:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970006.792308:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788970006.792313:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93200, rc 0) 00000100:00100000:1.0:1788970006.792393:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10569:x1875870732054656:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 541us (738us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788970006.792400:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 133 00000100:00080000:0.0:1788970006.792420:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970006.801593:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970006.801677:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732054784 00000100:00100000:3.0:1788970006.801693:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732054784 00000100:00100000:3.0:1788970006.802412:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 134 00000100:00100000:3.0:1788970006.802426:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787857c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10569:x1875870732054784:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:3.0:1788970006.802517:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970006.802540:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970006.802555:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970006.802590:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970006.802598:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970006.802607:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970006.802625:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970006.802631:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970006.802640:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970006.802656:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:3.0:1788970006.802659:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970006.802666:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970006.802672:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970006.802767:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787857c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:10569:x1875870732054784:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 344us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970006.802776:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 134 00000100:00100000:1.0:1788970006.894206:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970006.894325:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732054912 00000100:00100000:2.0:1788970006.894368:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732054912 00000100:00100000:2.0:1788970006.894518:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:2.0:1788970006.894532:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2356:x1875870732054912:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:2.0:1788970006.894557:0:8534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970006.894586:0:8534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4419 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea72 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970006.894620:0:8534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa18413, atime: 0x6aa18412, ctime: 0x6aa18413, blocks: 0xb 00010000:00010000:2.0:1788970006.894648:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1788970006.894653:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970006.894663:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4419 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea72 expref: 7 pid: 8534 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970006.894713:0:8534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4419 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea72 expref: 7 pid: 8534 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970006.894728:0:8534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d400, rc 0) 00000100:00100000:2.0:1788970006.894857:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732054912:12345-192.168.202.9@tcp:101:cat.0 Request processed in 321us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970006.894865:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:3.0:1788970006.900048:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970006.900288:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732055040 00000100:00100000:1.0:1788970006.900301:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732055040 00002000:00100000:1.0:1788970006.900383:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff97787929e940 x1875870732055040/t0(0) o3->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:537/0 lens 488/0 e 0 to 0 dl 1788970017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788970006.900396:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787929e940 with x1875870732055040 ext(0->4095) 00002000:00010000:1.0:1788970006.900404:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787929e940 00000100:00100000:1.0:1788970006.900444:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:1.0:1788970006.900457:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732055040:12345-192.168.202.9@tcp:3:cat.0 00000100:00100000:1.0:1788970006.900771:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732055040:12345-192.168.202.9@tcp:3:cat.0 Request processed in 315us (736us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788970006.900779:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00002000:00100000:1.0:1788970006.900825:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff97787929e940 x1875870732055040/t0(0) o3->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:537/0 lens 488/4536 e 0 to 0 dl 1788970017 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788970006.900845:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787929e940 with x1875870732055040 ext(0->4095) 00002000:00010000:1.0:1788970006.900918:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787929e940 00000100:00080000:0.0:1788970006.902189:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788970007.622042:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970008.661851:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788970008.664193:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1788970008.664217:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788970008.674633:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000001:00080000:0.0:1788970008.674646:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788970008.676586:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9778500ed900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788970008.676601:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977852cda500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9778500edb40 00000020:00080000:0.0:1788970008.676604:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977852cdaa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9778812e9400 00000020:00080000:0.0:1788970008.676630:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788970008.676880:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788970008.677144:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1788970009.029465:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970009.029498:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741497344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970009.029601:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970009.029757:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741497344 00000100:00100000:0.0:1788970009.029770:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741497344 00000100:00100000:0.0:1788970009.029879:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788970009.029893:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741497344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970009.029940:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970009.030001:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741497344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970009.030009:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788970009.030079:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741497344:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788970009.030282:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788970009.668958:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970009.670286:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970009.670349:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970009.670383:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970009.670408:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970009.670450:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970009.670482:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732055424 00000100:00100000:1.0:1788970009.670494:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732055424 00000100:00100000:1.0:1788970009.670567:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732055552 00000100:00100000:1.0:1788970009.670569:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732055552 00000100:00100000:1.0:1788970009.670614:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:1.0:1788970009.670623:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732055424:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970009.670702:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732055168 00000100:00100000:3.0:1788970009.670709:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732055168 00000100:00100000:1.0:1788970009.670726:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732055424:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970009.670735:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:3.0:1788970009.670751:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 286 00000100:00100000:3.0:1788970009.670763:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732055168:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970009.670767:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:1.0:1788970009.670778:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732055552:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970009.670841:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732055552:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 66us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970009.670849:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732055168:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 89us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970009.670850:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:3.0:1788970009.670863:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 286 00000100:00100000:1.0:1788970009.670877:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732055680 00000100:00100000:1.0:1788970009.670882:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732055680 00000100:00100000:1.0:1788970009.670917:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732055296 00000100:00100000:1.0:1788970009.670921:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732055296 00000100:00100000:1.0:1788970009.670949:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 132 00000100:00100000:1.0:1788970009.670957:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732055680:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970009.670994:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732055680:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 38us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970009.671002:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 132 00000100:00100000:1.0:1788970009.671015:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 133 00000100:00100000:1.0:1788970009.671022:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2353:x1875870732055296:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970009.671049:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2353:x1875870732055296:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 28us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970009.671056:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 133 00000100:00080000:1.0:1788970009.671103:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970009.671116:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970009.671119:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970010.053348:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787929f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741497472:0@lo:400:kworker.0 00000100:00100000:3.0:1788970010.053452:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970010.053511:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787929cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741497984:0@lo:400:kworker.0 00000100:00100000:3.0:1788970010.053544:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970010.053573:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788970010.053580:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787929f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741497600:0@lo:400:kworker.0 00000100:00100000:3.0:1788970010.053604:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970010.053619:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787929d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741498112:0@lo:400:kworker.0 00000100:00100000:3.0:1788970010.053643:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970010.053671:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787929e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741497728:0@lo:400:kworker.0 00000100:00100000:3.0:1788970010.053695:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970010.053714:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970010.053719:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787929da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741497856:0@lo:400:kworker.0 00000100:00100000:3.0:1788970010.053741:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970010.053777:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741497984 00000100:00100000:3.0:1788970010.053785:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741497984 00000100:00100000:2.0:1788970010.053962:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741498112 00000100:00100000:2.0:1788970010.053967:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741498112 00000100:00100000:2.0:1788970010.054042:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741497856 00000100:00100000:2.0:1788970010.054045:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741497856 00000100:00100000:2.0:1788970010.054070:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788970010.054081:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741498112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970010.054151:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741498112:12345-0@lo:400:kworker.0 Request processed in 73us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970010.054160:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788970010.054179:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788970010.054185:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741497856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970010.054212:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741497856:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970010.054218:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788970010.054238:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741498240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970010.054279:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970010.054335:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787929da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741497856:0@lo:400:kworker.0 00000100:00100000:2.0:1788970010.054368:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741498240 00000100:00100000:2.0:1788970010.054372:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741498240 00000100:00100000:2.0:1788970010.054400:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970010.054407:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741498240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970010.054444:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970010.054483:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741498240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970010.054488:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970010.054516:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788970010.054521:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97787ff20f00, transno 4294967310 00000004:00080000:2.0:1788970010.054531:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788970010.054555:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741498240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970010.054595:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787929d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741498112:0@lo:400:kworker.0 00000100:00100000:1.0:1788970010.054854:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741497472 00000100:00100000:1.0:1788970010.054859:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741497472 00000100:00100000:1.0:1788970010.054891:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788970010.054899:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741497472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970010.054948:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741497472:12345-0@lo:400:kworker.0 Request processed in 51us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970010.054954:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788970010.054982:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741497600 00000100:00100000:1.0:1788970010.054986:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741497600 00000100:00100000:1.0:1788970010.055012:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741497728 00000100:00100000:1.0:1788970010.055016:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741497728 00000100:00100000:1.0:1788970010.055035:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788970010.055041:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741497600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970010.055075:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741497600:12345-0@lo:400:kworker.0 Request processed in 34us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970010.055081:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788970010.055092:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788970010.055098:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741497728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970010.055131:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741497728:12345-0@lo:400:kworker.0 Request processed in 33us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970010.055137:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788970010.055160:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970010.055166:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970010.055637:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787929e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741497728:0@lo:400:kworker.0 00000100:00100000:1.0:1788970010.055667:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787929f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741497600:0@lo:400:kworker.0 00000100:00100000:1.0:1788970010.055689:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787929f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741497472:0@lo:400:kworker.0 00000100:00100000:3.0:1788970010.055853:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788970010.055858:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741497984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970010.055896:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741497984:12345-0@lo:400:kworker.0 Request processed in 39us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970010.055900:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788970010.055921:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787929cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741497984:0@lo:400:kworker.0 00000100:00080000:1.0:1788970010.056997:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788970010.693087:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970011.718904:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970012.057952:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970012.058397:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732055808 00000100:00100000:1.0:1788970012.058487:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732055808 00000100:00080000:2.0:1788970012.060073:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970012.066939:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 135 00000100:00100000:0.0:1788970012.066968:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:10222:x1875870732055808:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788970012.067127:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:10222:x1875870732055808:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 Request processed in 173us (9191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970012.067135:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 135 00000100:00100000:3.0:1788970012.069829:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970012.070330:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732056064 00000100:00100000:1.0:1788970012.070345:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732056064 00000100:00100000:1.0:1788970012.070491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:1.0:1788970012.070505:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:10222:x1875870732056064:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788970012.071004:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:10222:x1875870732056064:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 502us (1224us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788970012.071014:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00010000:00010000:1.0:1788970012.741299:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788970013.685730:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788970013.686060:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788970013.686093:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788970013.686108:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788970013.767866:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788970013.896167:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970013.896182:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970013.899241:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788970013.899260:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970014.155639:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787929e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741498368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970014.155747:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970014.155916:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741498368 00000100:00100000:3.0:1788970014.155927:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741498368 00000100:00100000:3.0:1788970014.156006:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788970014.156018:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741498368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970014.156068:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788970014.156126:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741498368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970014.156133:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788970014.156163:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970014.156214:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787929e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741498368:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788970014.307869:0:12277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:06:53 (1788970013) 00000100:00100000:3.0:1788970014.777392:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970014.777453:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970014.777492:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970014.777528:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970014.777561:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970014.777604:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732056704 00000100:00100000:3.0:1788970014.777617:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732056704 00000100:00100000:3.0:1788970014.777693:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732056320 00000100:00100000:3.0:1788970014.777697:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732056320 00000100:00100000:3.0:1788970014.777747:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 137 00000100:00100000:3.0:1788970014.777771:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2355:x1875870732056704:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970014.777908:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2355:x1875870732056704:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 150us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970014.777917:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 137 00000100:00100000:3.0:1788970014.777936:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 138 00000100:00100000:3.0:1788970014.777943:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2355:x1875870732056320:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970014.777974:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2355:x1875870732056320:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970014.777981:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 138 00000100:00100000:3.0:1788970014.778005:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732056448 00000100:00100000:3.0:1788970014.778009:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732056448 00000100:00100000:3.0:1788970014.778037:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732056576 00000100:00100000:3.0:1788970014.778041:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732056576 00000100:00100000:3.0:1788970014.778062:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:3.0:1788970014.778070:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2355:x1875870732056448:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970014.778097:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2355:x1875870732056448:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 29us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970014.778104:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:3.0:1788970014.778115:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:3.0:1788970014.778122:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732056576:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970014.778147:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2355:x1875870732056576:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970014.778153:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00080000:3.0:1788970014.778171:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970014.778183:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970014.778186:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970014.778590:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732056192 00000100:00100000:0.0:1788970014.778598:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732056192 00000100:00100000:0.0:1788970014.778640:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 288 00000100:00100000:0.0:1788970014.778648:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2355:x1875870732056192:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970014.778691:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2355:x1875870732056192:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 44us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970014.778698:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 288 00010000:00010000:1.0:1788970014.790490:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970015.173525:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741498496:0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.173633:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970015.173712:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741499008:0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.173744:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970015.173814:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788970015.173821:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741498624:0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.173851:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970015.173870:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741499136:0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.173897:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970015.173942:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741498880:0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.173969:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970015.174002:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970015.174008:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741498752:0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.174030:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970015.174063:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741499008 00000100:00100000:3.0:1788970015.174073:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741499008 00000100:00100000:3.0:1788970015.174138:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741498624 00000100:00100000:3.0:1788970015.174141:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741498624 00000100:00100000:3.0:1788970015.174154:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741498752 00000100:00100000:3.0:1788970015.174157:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741498752 00000100:00100000:3.0:1788970015.174175:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788970015.174185:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741499008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.174438:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741499008:12345-0@lo:400:kworker.0 Request processed in 253us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970015.174446:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788970015.174484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788970015.174489:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741498624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.174520:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741498624:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970015.174526:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788970015.174538:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788970015.174544:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741498752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.174575:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741498752:12345-0@lo:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970015.174580:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1788970015.174598:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970015.174635:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778539b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741498752:0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.174665:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741499136 00000100:00100000:3.0:1788970015.174669:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741499136 00000100:00100000:3.0:1788970015.174700:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741498880 00000100:00100000:3.0:1788970015.174703:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741498880 00000100:00100000:3.0:1788970015.174723:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788970015.174730:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778453770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741499136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.174763:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778453770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741499136:12345-0@lo:400:kworker.0 Request processed in 34us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970015.174770:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788970015.174780:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970015.174786:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741498880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970015.174845:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741498880:12345-0@lo:400:kworker.0 Request processed in 59us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970015.174851:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788970015.174874:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970015.174891:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741498880:0@lo:400:kworker.0 00000100:00100000:0.0:1788970015.175215:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741498624:0@lo:400:kworker.0 00000100:00100000:0.0:1788970015.175229:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741499136:0@lo:400:kworker.0 00000100:00100000:0.0:1788970015.175241:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741499008:0@lo:400:kworker.0 00000100:00100000:1.0:1788970015.175398:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741498496 00000100:00100000:1.0:1788970015.175403:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741498496 00000100:00100000:1.0:1788970015.175447:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788970015.175455:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741498496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970015.175512:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741498496:12345-0@lo:400:kworker.0 Request processed in 58us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970015.175519:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788970015.175573:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741498496:0@lo:400:kworker.0 00000100:00100000:2.0:1788970015.175928:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741499264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970015.175972:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970015.176195:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741499264 00000100:00100000:1.0:1788970015.176211:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741499264 00000100:00100000:1.0:1788970015.176265:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788970015.176274:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741499264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970015.176311:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970015.176357:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741499264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970015.176364:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788970015.176994:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787fa15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741499264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970015.626630:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970015.626728:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732056960 00000100:00100000:3.0:1788970015.626743:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732056960 00000100:00100000:3.0:1788970015.626864:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 136 00000100:00100000:3.0:1788970015.626878:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:11279:x1875870732056960:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970015.626908:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970015.626937:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4420 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea79 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627045:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627064:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627081:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627100:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627107:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627115:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627490:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4435 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627515:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4435 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627522:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4435 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970015.627535:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788970015.627716:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627725:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627732:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627738:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970015.627744:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627752:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627767:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff977843e0b300) 00010000:00010000:3.0:1788970015.627770:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970015.627775:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627781:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4427 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627832:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627846:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627851:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627856:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970015.627859:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627866:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627874:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff977858b3ca00) 00010000:00010000:3.0:1788970015.627876:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970015.627879:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.627885:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b442e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.628457:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4420 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea79 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.628479:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4435 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea79 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970015.628488:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:3.0:1788970015.628491:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970015.628500:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc600, rc 0) 00000100:00100000:3.0:1788970015.628606:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:11279:x1875870732056960:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1731us (1992us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788970015.628617:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 136 00000100:00100000:0.0:1788970015.642393:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970015.642450:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970015.642549:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732057088 00000100:00100000:1.0:1788970015.642562:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732057088 00000100:00100000:1.0:1788970015.642645:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:1.0:1788970015.642655:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:2355:x1875870732057088:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970015.642687:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970015.642726:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4435 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea79 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970015.642765:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:1.0:1788970015.642772:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970015.642883:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:2355:x1875870732057088:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 229us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970015.642892:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1788970015.645211:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732057216 00000100:00100000:3.0:1788970015.645233:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732057216 00000100:00100000:3.0:1788970015.649527:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 137 00000100:00100000:3.0:1788970015.649547:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878948b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:11279:x1875870732057216:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788970015.649745:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878948b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:11279:x1875870732057216:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 Request processed in 201us (7292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970015.649760:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 137 00010000:00010000:0.0:1788970015.813524:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970015.945068:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970015.945079:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970015.945132:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788970015.945140:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788970016.839257:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970017.804662:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970017.805113:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732057344 00000100:00100000:3.0:1788970017.805128:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732057344 00000100:00100000:3.0:1788970017.805243:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 138 00000100:00100000:3.0:1788970017.805261:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:11321:x1875870732057344:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970017.805289:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970017.805318:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea80 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805409:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805427:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805443:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805462:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805478:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805485:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788970017.805516:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788970017.805781:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805817:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805825:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805834:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970017.805839:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805850:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805867:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:3.0:1788970017.805870:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970017.805876:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805883:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b444a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805895:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805907:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805914:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805920:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970017.805923:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805929:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805937:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff977858b3c500) 00010000:00010000:3.0:1788970017.805939:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970017.805942:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805948:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b4451 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.805990:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4443 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea80 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.806002:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:3.0:1788970017.806006:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970017.806010:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea80 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.806021:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc000, rc 0) 00000100:00100000:3.0:1788970017.806124:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:11321:x1875870732057344:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 869us (1475us total) trans 0 rc 301/301 00000100:00100000:3.0:1788970017.806137:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 138 00000100:00100000:2.0:1788970017.816271:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970017.816361:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732057600 00000100:00100000:0.0:1788970017.816374:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732057600 00000100:00100000:0.0:1788970017.816466:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 139 00000100:00100000:0.0:1788970017.816482:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:11321:x1875870732057600:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:0.0:1788970017.816571:0:7061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970017.816609:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b3dcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8c0 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.816654:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c200) 00010000:00010000:0.0:1788970017.816680:0:7061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970017.817223:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.817250:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.817263:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.817277:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.817284:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.817291:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970017.820415:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788970017.820441:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.820453:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.820462:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.820469:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970017.820631:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.820641:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.820663:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672d00) 00010000:00010000:0.0:1788970017.820667:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970017.820673:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.820681:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4458 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970017.820920:0:7061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df938da5 reply state 0000000083ff23d5 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970017.820932:0:7061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970017.821076:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:11321:x1875870732057600:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 4593us (4812us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788970017.821087:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 139 00010000:00010000:2.0:1788970017.826997:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970017.827022:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970017.827032:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970017.827040:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970017.827046:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970017.827055:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970017.827077:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff977849672c00) 00010000:00010000:2.0:1788970017.827080:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970017.827087:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970017.827094:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b445f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970017.862477:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970017.918623:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970017.918711:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732057728 00000100:00100000:3.0:1788970017.918734:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732057728 00000100:00100000:3.0:1788970017.918840:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 140 00000100:00100000:3.0:1788970017.918852:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:11329:x1875870732057728:12345-192.168.202.9@tcp:101:lctl.0 00010000:00010000:3.0:1788970017.918884:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970017.918916:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea87 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.919000:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b446d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.919018:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b446d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.919033:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b446d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970017.919079:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788970017.919083:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970017.919105:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b446d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.919133:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea87 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.919156:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b446d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea87 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970017.919181:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c500) 00010000:00010000:3.0:1788970017.919184:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970017.919189:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd600, rc 0) 00000100:00100000:3.0:1788970017.919279:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:11329:x1875870732057728:12345-192.168.202.9@tcp:101:lctl.0 Request processed in 428us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970017.919287:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 140 00000100:00100000:0.0:1788970017.996677:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970017.996818:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732057856 00000100:00100000:1.0:1788970017.996829:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732057856 00000100:00100000:1.0:1788970017.996886:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 141 00000100:00100000:1.0:1788970017.996896:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787894a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+15:11335:x1875870732057856:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1788970017.996934:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970017.996957:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b4474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997028:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997044:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997056:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997071:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997080:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997086:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997187:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997196:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997203:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970017.997239:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788970017.997249:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970017.997287:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997301:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997463:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997474:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997481:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970017.997486:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997494:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997512:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c500) 00010000:00010000:1.0:1788970017.997516:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970017.997523:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997530:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b447b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997547:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997553:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997571:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997577:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970017.997580:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997587:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997595:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9778519abe00) 00010000:00010000:1.0:1788970017.997598:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970017.997600:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997606:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4482 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997644:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b4474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea8e expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997658:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea8e expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970017.997665:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970017.997668:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788970017.997670:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93000, rc 0) 00000100:00100000:1.0:1788970017.997739:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787894a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:11335:x1875870732057856:12345-192.168.202.9@tcp:101:bash.0 Request processed in 845us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970017.997755:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 141 00000100:00100000:1.0:1788970018.004429:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970018.004511:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732058112 00000100:00100000:2.0:1788970018.004530:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732058112 00000100:00100000:2.0:1788970018.004617:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 142 00000100:00100000:2.0:1788970018.004645:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+16:11335:x1875870732058112:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970018.004675:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970018.004714:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4490 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea95 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.005051:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.005072:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.005087:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.005238:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.005263:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.005277:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970018.006500:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788970018.006920:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.006937:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.006948:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.007009:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.007016:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.007023:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.007029:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44dc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970018.007033:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.007041:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.007055:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970018.007059:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970018.007065:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.007072:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4497 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970018.007089:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad7d0711 reply state 00000000d8a9e3f0 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970018.007100:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788970018.007377:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4490 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea95 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.007407:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea95 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.007416:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1300) 00010000:00010000:2.0:1788970018.007419:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970018.007421:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44da00, rc 0) 00000100:00100000:2.0:1788970018.007508:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11335:x1875870732058112:12345-192.168.202.9@tcp:101:bash.0 Request processed in 2865us (3092us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788970018.007517:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 142 00010000:00010000:1.0:1788970018.009254:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.009270:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.009291:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.009298:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970018.009302:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.009310:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.009325:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1c00) 00010000:00010000:1.0:1788970018.009328:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970018.009332:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.009339:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b449e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970018.018767:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970018.021502:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732058240 00000100:00100000:3.0:1788970018.021522:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732058240 00000100:00100000:2.0:1788970018.022640:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00080000:0.0:1788970018.022643:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970018.022662:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787fa14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732058240:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970018.022688:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970018.022726:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ea9c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970018.022767:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788970018.022812:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1788970018.022817:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970018.022839:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea9c expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.022861:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea9c expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.022902:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44ce00, rc 0) 00000100:00100000:2.0:1788970018.022989:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787fa14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732058240:12345-192.168.202.9@tcp:101:bash.0 Request processed in 337us (4238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970018.022997:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:3.0:1788970018.031576:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.031656:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732058368 00000100:00100000:1.0:1788970018.031676:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732058368 00000100:00100000:1.0:1788970018.031808:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:1.0:1788970018.031820:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:11335:x1875870732058368:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1788970018.031871:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970018.031907:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eaa3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.032058:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea9c expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.032071:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970018.032077:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970018.032085:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.032139:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea9c expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.032159:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea9c expref: 7 pid: 6679 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970018.032176:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875870741499392:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970018.032405:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778785b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970018.042530:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875870741499392:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970018.043215:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.043499:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92a00, rc 0) 00000100:00100000:2.0:1788970018.044433:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:11335:x1875870732058368:12345-192.168.202.9@tcp:101:bash.0 Request processed in 12608us (14250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970018.044446:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:1.0:1788970018.048651:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970018.049272:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732058496 00000100:00100000:3.0:1788970018.049300:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732058496 00010000:00010000:3.0:1788970018.049355:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea9c expref: 7 pid: 6679 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970018.049417:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:3.0:1788970018.049428:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732058496:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970018.049443:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970018.049468:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea9c expref: 7 pid: 6679 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.049486:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea9c expref: 7 pid: 6679 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.049516:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000400cd32c/0x5d0de860b05b44b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea9c expref: 7 pid: 6679 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.049558:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788970018.049563:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970018.049572:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.049583:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.049628:0:11142:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970018.049643:0:11142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865086580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11142:1875870741499520:192.168.202.9@tcp:105: 00000100:00100000:3.0:1788970018.051240:0:11142:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970018.053627:0:11142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865086580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11142:1875870741499520:192.168.202.9@tcp:105: 00010000:00010000:3.0:1788970018.053657:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970018.053718:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2356:x1875870732058496:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 4290us (5083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970018.053740:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:0.0:1788970018.055436:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970018.055556:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732058752 00000100:00100000:2.0:1788970018.055565:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732058752 00000100:00100000:2.0:1788970018.055670:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:2.0:1788970018.055683:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:11335:x1875870732058752:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:2.0:1788970018.056120:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11335:x1875870732058752:12345-192.168.202.9@tcp:35:bash.0 Request processed in 439us (690us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788970018.056128:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:2.0:1788970018.230732:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.231485:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732059008 00000100:00100000:1.0:1788970018.231497:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732059008 00000100:00100000:1.0:1788970018.231570:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 143 00000100:00100000:1.0:1788970018.231580:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11345:x1875870732059008:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970018.231607:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970018.231644:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b44c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eaaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970018.231747:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788970018.232156:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b44c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaaa expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.232171:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c500) 00010000:00010000:1.0:1788970018.232174:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970018.232179:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b44c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaaa expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.232196:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93400, rc 0) 00000100:00100000:1.0:1788970018.232343:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:11345:x1875870732059008:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 699us (1567us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788970018.232351:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 143 00000100:00100000:3.0:1788970018.240150:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.240577:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732059264 00000100:00100000:1.0:1788970018.240588:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732059264 00000100:00100000:1.0:1788970018.240655:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:1.0:1788970018.240665:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865086580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:11345:x1875870732059264:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970018.241246:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865086580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:11345:x1875870732059264:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 579us (1104us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788970018.241255:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:2.0:1788970018.360029:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970018.360165:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732059392 00000100:00100000:3.0:1788970018.360176:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732059392 00000100:00100000:3.0:1788970018.360300:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 144 00000100:00100000:3.0:1788970018.360312:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:11351:x1875870732059392:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970018.360337:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970018.360374:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b44cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eab1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.360445:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b44d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.360461:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b44d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.360475:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b44d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970018.360512:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788970018.360516:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970018.360535:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b44d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.360563:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b44cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eab1 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.360583:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b44d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eab1 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.360591:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:3.0:1788970018.360594:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970018.360598:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd400, rc 0) 00000100:00100000:3.0:1788970018.360666:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:11351:x1875870732059392:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 357us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970018.360674:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 144 00000100:00100000:2.0:1788970018.376505:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.379282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732059648 00000100:00100000:1.0:1788970018.379300:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732059648 00000100:00100000:1.0:1788970018.379458:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 145 00000100:00100000:1.0:1788970018.379470:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:11351:x1875870732059648:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970018.379512:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970018.379536:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b44dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eab8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.379640:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b44e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.379655:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b44e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.379669:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b44e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970018.379682:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788970018.380589:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b44dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eab8 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.380613:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b44e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eab8 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.380621:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1300) 00010000:00010000:1.0:1788970018.380624:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970018.380627:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92e00, rc 0) 00000100:00100000:1.0:1788970018.380711:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11351:x1875870732059648:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1243us (4218us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788970018.380718:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 145 00000100:00100000:3.0:1788970018.388924:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970018.390013:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732060032 00000100:00100000:0.0:1788970018.390025:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732060032 00000100:00100000:0.0:1788970018.390096:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 146 00000100:00100000:0.0:1788970018.390107:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11351:x1875870732060032:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970018.390133:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970018.390167:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b44f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eabf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.390357:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b44f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.390374:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b44f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.390387:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b44f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970018.390401:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788970018.390535:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b44f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eabf expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.390557:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b44f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eabf expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.390566:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1300) 00010000:00010000:0.0:1788970018.390570:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788970018.390573:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484800, rc 0) 00000100:00100000:0.0:1788970018.392002:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11351:x1875870732060032:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1885us (3078us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788970018.392015:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 146 00000100:00100000:3.0:1788970018.400471:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970018.400640:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732059776 00000100:00100000:0.0:1788970018.400666:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732059776 00000100:00100000:0.0:1788970018.400755:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:0.0:1788970018.400773:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:2356:x1875870732059776:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970018.400836:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970018.400870:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b44e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eab8 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.400894:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1300) 00010000:00010000:0.0:1788970018.400901:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970018.400958:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:2356:x1875870732059776:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 187us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970018.400967:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1788970018.404188:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.404365:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732060160 00000100:00100000:1.0:1788970018.404378:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732060160 00000100:00100000:1.0:1788970018.404443:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:1.0:1788970018.404469:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787892bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732060160:12345-192.168.202.9@tcp:1:lfs.0 00010000:00010000:1.0:1788970018.404529:0:8534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.404555:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.404563:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970018.404568:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970018.404573:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.404709:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.404738:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 6 pid: 6676 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970018.404767:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fcad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8534:1875870741499648:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970018.404941:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970018.414171:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fcad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8534:1875870741499648:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970018.414216:0:8534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970018.414852:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970018.414972:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732060288 00000100:00100000:0.0:1788970018.414982:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732060288 00002000:00100000:0.0:1788970018.415055:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97787893b0c0 x1875870732060288/t0(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:549/0 lens 504/0 e 0 to 0 dl 1788970029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970018.415087:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787893b0c0 with x1875870732060288 ext(0->12) 00010000:00010000:0.0:1788970018.415098:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 7 pid: 6676 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.415117:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 7 pid: 6676 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970018.415126:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97787893b0c0 00000100:00100000:0.0:1788970018.415167:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:0.0:1788970018.415181:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732060288:12345-192.168.202.9@tcp:4:lfs.0 00000100:00100000:0.0:1788970018.415897:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2353:x1875870732060288:12345-192.168.202.9@tcp:4:lfs.0 Request processed in 715us (1044us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788970018.415908:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00002000:00100000:0.0:1788970018.415920:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97787893b0c0 x1875870732060288/t4294967305(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:549/0 lens 504/448 e 0 to 0 dl 1788970029 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970018.415929:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787893b0c0 with x1875870732060288 ext(0->12) 00010000:00010000:0.0:1788970018.415938:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 9 pid: 6676 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.415955:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 9 pid: 6676 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970018.415963:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97787893b0c0 00000100:00100000:1.0:1788970018.418170:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970018.418305:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732060416 00000100:00100000:2.0:1788970018.418318:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732060416 00010000:00010000:2.0:1788970018.418386:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 9 pid: 6676 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970018.418439:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:2.0:1788970018.418452:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2356:x1875870732060416:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970018.418475:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788970018.418502:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788970018.418506:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788970018 00002000:00010000:2.0:1788970018.418510:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788970018 00002000:00010000:2.0:1788970018.418512:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788970018 00010000:00010000:2.0:1788970018.418520:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 9 pid: 6676 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.418537:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 9 pid: 6676 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.418566:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b44ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaa3 expref: 9 pid: 6676 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.418599:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970018.418604:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970018.418611:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.418622:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.418685:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970018.418758:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2356:x1875870732060416:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 308us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970018.418768:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 61 00010000:00010000:0.0:1788970018.421180:0:8534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.421235:0:8534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.421288:0:8534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.421298:0:8534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.421308:0:8534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.421316:0:8534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970018.421321:0:8534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.421331:0:8534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.421353:0:8534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.421362:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfbc62b3/0x5d0de860b05b4507 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970018.421505:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787892bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732060160:12345-192.168.202.9@tcp:1:lfs.0 Request processed in 17032us (17321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970018.421518:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:1.0:1788970018.424430:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970018.425216:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732060672 00000100:00100000:2.0:1788970018.425301:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732060672 00000100:00100000:2.0:1788970018.425405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:2.0:1788970018.425417:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507a8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:11351:x1875870732060672:12345-192.168.202.9@tcp:35:lfs.0 00000004:00010000:2.0:1788970018.425486:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b44f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eabf expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970018.425769:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788970018.425862:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788970018.426388:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788970018.426445:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.426462:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea95 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.426471:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.426506:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea95 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.426524:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea95 expref: 29 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970018.426547:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff20780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875870741499776:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970018.426643:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788970018.429601:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff20780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875870741499776:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970018.429639:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970018.431467:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970018.432456:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732060800 00000100:00100000:0.0:1788970018.432474:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732060800 00010000:00010000:0.0:1788970018.432538:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea95 expref: 30 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970018.432596:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:0.0:1788970018.432610:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:2353:x1875870732060800:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970018.432630:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970018.432639:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea95 expref: 30 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.432659:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea95 expref: 30 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.432688:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b44a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea95 expref: 30 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.432707:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1300) 00010000:00010000:0.0:1788970018.432714:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.432725:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.432757:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.432844:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970018.432926:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:2353:x1875870732060800:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 319us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970018.432935:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00010000:00010000:3.0:1788970018.433023:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.433040:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970018.433188:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788970018.433517:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788970018.433680:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e93840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741499904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788970018.433761:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970018.433963:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741499904 00000100:00100000:1.0:1788970018.433973:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741499904 00000100:00100000:1.0:1788970018.434054:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970018.434065:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875870741499904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788970018.434177:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970018.438772:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875870741499904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 4698us (4999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970018.438815:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788970018.439343:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850e16e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970018.439377:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e93840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741499904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788970018.440338:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788970018.440437:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff21a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741500032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788970018.440499:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970018.440585:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970018.440635:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741500032 00000100:00100000:3.0:1788970018.440644:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741500032 00000100:00100000:2.0:1788970018.441463:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970018.441487:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875870741500032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788970018.441876:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875870741500032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 399us (1374us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788970018.441885:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970018.442070:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff21a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741500032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788970018.442139:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788970018.442183:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.442194:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.442201:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.442206:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970018.442303:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.442312:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.442330:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1300) 00010000:00010000:3.0:1788970018.442334:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788970018.442339:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970018.442346:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b450e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788970018.442555:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788970018.442655:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788970018.442667:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330405876408ns, next at 331405873582ns, rc = 0 00000001:00080000:3.0:1788970018.443072:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788970018.443130:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1300) 00010000:00010000:3.0:1788970018.443133:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788970018.443141:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b44f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eabf expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970018.443484:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507a8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:11351:x1875870732060672:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 18067us (19063us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788970018.443494:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000020:00080000:2.0:1788970018.443500:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788970018.446954:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970018.447373:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732060928 00000100:00100000:0.0:1788970018.447391:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732060928 00000100:00100000:0.0:1788970018.447481:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 147 00000100:00100000:0.0:1788970018.447495:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:11351:x1875870732060928:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970018.447532:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970018.447566:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4515 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eac6 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.447653:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eac6 expref: 33 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.447673:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eac6 expref: 33 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.447697:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:0.0:1788970018.447701:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970018.447707:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484400, rc 0) 00000100:00100000:0.0:1788970018.447850:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:11351:x1875870732060928:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 357us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970018.447879:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 147 00000100:00100000:3.0:1788970018.451562:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.451676:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732061184 00000100:00100000:1.0:1788970018.451685:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732061184 00000100:00100000:1.0:1788970018.451996:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:1.0:1788970018.452009:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:11351:x1875870732061184:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970018.452266:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11351:x1875870732061184:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 259us (713us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788970018.452274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:0.0:1788970018.531543:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.531676:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732061440 00000100:00100000:1.0:1788970018.531687:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732061440 00000100:00100000:2.0:1788970018.532283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 148 00000100:00100000:2.0:1788970018.532297:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11361:x1875870732061440:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970018.532340:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970018.532362:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b451c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eacd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970018.532446:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788970018.532571:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b451c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eacd expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.532585:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c500) 00010000:00010000:2.0:1788970018.532589:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970018.532594:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b451c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eacd expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.532609:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44ca00, rc 0) 00000100:00100000:2.0:1788970018.532732:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11361:x1875870732061440:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 430us (1190us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788970018.532739:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 148 00000100:00100000:3.0:1788970018.536668:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970018.537264:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732061568 00000100:00100000:2.0:1788970018.537274:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732061568 00000100:00100000:2.0:1788970018.537512:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 149 00000100:00100000:2.0:1788970018.537524:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11361:x1875870732061568:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:2.0:1788970018.537603:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.537622:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.537634:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.537667:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.537674:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.537680:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538016:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538026:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538033:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970018.538079:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538092:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538098:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538104:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538110:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970018.538114:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538128:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538140:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970018.538143:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970018.538148:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538154:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b452a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538168:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538174:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538180:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538186:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44da00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970018.538188:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538194:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538200:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1200) 00010000:00010000:2.0:1788970018.538203:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970018.538205:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538230:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538245:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538251:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538257:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538262:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970018.538265:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538271:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538279:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970018.538281:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970018.538284:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.538290:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970018.538421:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11361:x1875870732061568:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 898us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970018.538429:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 149 00000100:00100000:3.0:1788970018.542256:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.542466:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732061824 00000100:00100000:1.0:1788970018.542476:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732061824 00000100:00100000:1.0:1788970018.542532:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:1.0:1788970018.542543:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11361:x1875870732061824:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970018.543237:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11361:x1875870732061824:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 693us (986us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788970018.543246:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:3.0:1788970018.599908:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970018.600164:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732062080 00000100:00100000:0.0:1788970018.600174:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732062080 00000100:00100000:0.0:1788970018.600244:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 150 00000100:00100000:0.0:1788970018.600255:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11364:x1875870732062080:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970018.600283:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970018.600303:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b453f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ead4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600375:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600390:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600401:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600414:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600420:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600427:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600546:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600572:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600579:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970018.600588:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788970018.600700:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600708:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600715:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600721:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970018.600725:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600734:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600746:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:0.0:1788970018.600749:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970018.600754:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600761:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4546 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.600775:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.601251:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.601262:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.601267:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970018.601270:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.601277:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.601284:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977849672500) 00010000:00010000:0.0:1788970018.601287:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970018.601290:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.601295:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b454d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.601344:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b453f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ead4 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.601359:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ead4 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.601366:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:0.0:1788970018.601368:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970018.601379:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484a00, rc 0) 00000100:00100000:0.0:1788970018.601545:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11364:x1875870732062080:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1291us (1645us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788970018.601553:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 150 00000100:00100000:3.0:1788970018.608424:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970018.608512:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732062208 00000100:00100000:0.0:1788970018.608521:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732062208 00000100:00100000:0.0:1788970018.608573:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 151 00000100:00100000:0.0:1788970018.608583:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11364:x1875870732062208:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:0.0:1788970018.608660:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.608689:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.608704:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.608741:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.608749:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.608756:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.608770:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970018.608774:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.608782:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.609063:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:0.0:1788970018.609066:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970018.609071:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.609078:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970018.609146:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11364:x1875870732062208:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 564us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970018.609152:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 151 00000100:00100000:2.0:1788970018.611536:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.614295:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732062464 00000100:00100000:1.0:1788970018.614310:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732062464 00000100:00100000:1.0:1788970018.614374:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:1.0:1788970018.614385:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11364:x1875870732062464:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970018.614622:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+39:11364:x1875870732062464:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 239us (3093us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788970018.614629:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00000001:00080000:1.0:1788970018.845490:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000001:00080000:1.0:1788970018.846633:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000020:00080000:1.0:1788970018.846669:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9778813a9b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788970018.846674:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977851907200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9778813a9540 00000020:00080000:1.0:1788970018.846678:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977851907e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff977880eb6400 00000004:00080000:1.0:1788970018.846708:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788970018.847013:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:2.0:1788970018.847020:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1788970018.847043:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741500160:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788970018.847147:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970018.847281:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741500160 00000100:00100000:0.0:1788970018.847291:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741500160 00000020:00080000:2.0:1788970018.847307:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788970018.847353:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788970018.847367:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977852ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875870741500160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788970018.847401:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788970018.847445:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa18422, atime: 0x6aa18422, ctime: 0x6aa18422, blocks: 0x1 00010000:00010000:0.0:1788970018.847455:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.847476:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1788970018.847481:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970018.847489:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.847529:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.847541:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.847549:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.847576:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788970018.848240:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977852ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741500160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 875us (1092us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788970018.848250:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1788970018.848999:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970018.849015:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.849029:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970018.849034:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.849046:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.849069:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.849077:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4569 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.849104:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970018.849106:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970018.849108:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788970018.849203:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff977877fca1c0/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788970018.849213:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741500160:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788970018.862953:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970018.868067:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732062720 00000100:00100000:2.0:1788970018.868091:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732062720 00000100:00100000:2.0:1788970018.868194:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 152 00000100:00100000:2.0:1788970018.868207:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:11395:x1875870732062720:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:2.0:1788970018.868258:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970018.868303:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eadb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.868446:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b4577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.868465:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.868479:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970018.868493:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788970018.868783:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eadb expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.868857:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b4577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eadb expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.868867:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970018.868871:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970018.868876:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d200, rc 0) 00000100:00100000:2.0:1788970018.868963:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11395:x1875870732062720:12345-192.168.202.9@tcp:101:cat.0 Request processed in 758us (6030us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788970018.868972:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 152 00000100:00100000:3.0:1788970018.876834:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970018.876915:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970018.877055:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732062976 00000100:00100000:1.0:1788970018.877072:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732062976 00000100:00100000:1.0:1788970018.877166:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:1.0:1788970018.877178:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11395:x1875870732062976:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:1.0:1788970018.877480:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:11395:x1875870732062976:12345-192.168.202.9@tcp:35:cat.0 Request processed in 298us (559us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788970018.877483:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732063104 00000100:00100000:1.0:1788970018.877492:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:0.0:1788970018.877495:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732063104 00000100:00100000:0.0:1788970018.877574:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:0.0:1788970018.877587:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:2354:x1875870732063104:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970018.877605:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970018.877644:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b4577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eadb expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.877669:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:0.0:1788970018.877676:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970018.877736:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:2354:x1875870732063104:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 152us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970018.877757:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00010000:00010000:0.0:1788970018.885056:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970018.954289:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970018.954514:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732063360 00000100:00100000:2.0:1788970018.954525:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732063360 00000100:00100000:2.0:1788970018.954591:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 153 00000100:00100000:2.0:1788970018.954603:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11401:x1875870732063360:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:2.0:1788970018.954647:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970018.954651:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788970018.955605:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b44d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eab1 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.955632:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970018.955638:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970018.955658:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4585 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eae2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.955779:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.955823:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ead4 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.955832:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.955867:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ead4 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.955884:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ead4 expref: 19 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970018.955900:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878949a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741500288:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970018.956002:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970018.958306:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878949a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741500288:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970018.958352:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970018.960567:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970018.961288:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732063488 00000100:00100000:2.0:1788970018.961301:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732063488 00010000:00010000:2.0:1788970018.961348:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ead4 expref: 20 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970018.961389:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:2.0:1788970018.961399:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:2353:x1875870732063488:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970018.961415:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970018.961422:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ead4 expref: 20 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.961436:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ead4 expref: 20 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.961459:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ead4 expref: 20 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.961481:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970018.961488:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.961574:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.961583:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.961638:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970018.961698:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:2353:x1875870732063488:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 300us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970018.961707:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00010000:00010000:1.0:1788970018.963338:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.963353:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970018.963377:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788970018.963691:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4585 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae2 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.963713:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae2 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970018.964203:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:1.0:1788970018.964206:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970018.964210:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44cc00, rc 0) 00000100:00100000:1.0:1788970018.964471:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11401:x1875870732063360:12345-192.168.202.9@tcp:101:dd.0 Request processed in 9870us (10190us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788970018.964478:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 153 00000100:00100000:3.0:1788970018.967621:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970018.967750:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732063744 00000100:00100000:2.0:1788970018.968212:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732063744 00000100:00100000:2.0:1788970018.968292:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 154 00000100:00100000:2.0:1788970018.968303:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11401:x1875870732063744:12345-192.168.202.9@tcp:36:dd.0 00010000:00010000:2.0:1788970018.969126:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.969145:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970018.969158:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970018.969226:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788970018.969252:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c87f9ad reply state 000000002bd3c3b2 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970018.969261:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970018.969406:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:11401:x1875870732063744:12345-192.168.202.9@tcp:36:dd.0 Request processed in 1102us (1793us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788970018.969414:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 154 00000020:00080000:2.0:1788970018.969420:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788970018.978463:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.978488:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.978498:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.978506:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970018.978512:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.978522:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.978543:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:0.0:1788970018.978546:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970018.978552:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970018.978559:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b459a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970019.270978:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970019.271025:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741500416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970019.271108:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970019.271209:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741500416 00000100:00100000:2.0:1788970019.271231:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741500416 00000100:00100000:2.0:1788970019.271302:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788970019.271332:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875870741500416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970019.271365:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970019.271462:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875870741500416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970019.271470:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788970019.275599:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741500416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970019.329226:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970019.334184:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732063872 00000100:00100000:1.0:1788970019.334204:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732063872 00000100:00100000:1.0:1788970019.334317:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 155 00000100:00100000:1.0:1788970019.334329:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:11415:x1875870732063872:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:1.0:1788970019.334374:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970019.334401:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b45a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eae9 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334507:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334524:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334541:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334557:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334564:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334571:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334934:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334947:0:7061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae2 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334956:0:7061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.334995:0:7061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae2 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.335020:0:7061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae2 expref: 22 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970019.335038:0:7061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789383c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741500544:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970019.335163:0:7061:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362b900 going to sleep for 11 seconds 00000100:00080000:0.0:1788970019.336264:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970019.345995:0:7061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789383c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741500544:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970019.346039:0:7061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970019.349545:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.349610:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732064128 00000100:00100000:2.0:1788970019.349621:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732064128 00000100:00100000:2.0:1788970019.349677:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:2.0:1788970019.349699:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:5596:x1875870732064128:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788970019.351265:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:5596:x1875870732064128:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 1570us (1721us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788970019.351276:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:1.0:1788970019.361500:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970019.362178:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732064256 00000100:00100000:3.0:1788970019.362189:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732064256 00010000:00010000:3.0:1788970019.362266:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae2 expref: 24 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970019.362423:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:2.0:1788970019.362436:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:2354:x1875870732064256:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970019.362454:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970019.362462:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae2 expref: 24 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.362477:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae2 expref: 24 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.362501:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b458c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae2 expref: 24 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.362517:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970019.362538:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.362548:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.362557:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.362609:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970019.362661:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:2354:x1875870732064256:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 227us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970019.362670:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00010000:00010000:2.0:1788970019.363228:0:7061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.363238:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970019.363285:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788970019.363289:0:7061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970019.365672:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.365697:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.365709:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.365723:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.365745:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.365751:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.365756:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.365765:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.365813:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970019.365817:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.367378:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367393:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b45a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367412:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367418:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367424:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367429:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.367432:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367455:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367467:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9778519abe00) 00010000:00010000:2.0:1788970019.367469:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.367472:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367478:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b45af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367523:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b45a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae9 expref: 23 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367537:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae9 expref: 22 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.367544:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970019.367546:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970019.367548:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92200, rc 0) 00000100:00100000:2.0:1788970019.368235:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:11415:x1875870732063872:12345-192.168.202.9@tcp:101:stat.0 Request processed in 33905us (39024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970019.368244:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 155 00000001:00080000:0.0:1788970019.404129:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788970019.404152:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788970019.446551:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970019.446653:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732064512 00000100:00100000:3.0:1788970019.446664:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732064512 00000100:00100000:3.0:1788970019.446730:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 156 00000100:00100000:3.0:1788970019.446741:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:11421:x1875870732064512:12345-192.168.202.9@tcp:36:truncate.0 00010000:00010000:3.0:1788970019.446942:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970019.446970:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b45b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eae9 expref: 22 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970019.447002:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:3.0:1788970019.447008:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970019.447369:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970019.447384:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970019.447411:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970019.447455:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788970019.447472:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c64d247 reply state 00000000d9d9b1bb transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970019.447478:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970019.450468:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11421:x1875870732064512:12345-192.168.202.9@tcp:36:truncate.0 Request processed in 3713us (3912us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788970019.450483:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 156 00000020:00080000:3.0:1788970019.450494:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788970019.456064:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.456086:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.456094:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.456101:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970019.456107:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.456115:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.456133:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:1.0:1788970019.456153:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970019.456159:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.456166:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b45bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970019.588354:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.588454:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732064640 00000100:00100000:2.0:1788970019.588465:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732064640 00000100:00100000:2.0:1788970019.588531:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 157 00000100:00100000:2.0:1788970019.588542:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:11435:x1875870732064640:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:2.0:1788970019.588585:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970019.588607:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b45c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eaf0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.588673:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.588690:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.588700:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.588714:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.588720:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.588725:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589056:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589065:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589072:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970019.589106:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788970019.589116:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970019.589138:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589148:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589154:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589159:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589163:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589169:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44dc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.589174:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589182:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589193:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970019.589197:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.589202:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589220:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b45cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589233:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589253:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589259:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589264:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.589267:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589274:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589282:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1400) 00010000:00010000:2.0:1788970019.589285:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.589288:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589293:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589325:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b45c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf0 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589338:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf0 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.589345:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970019.589347:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970019.589356:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44cc00, rc 0) 00000100:00100000:2.0:1788970019.589461:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11435:x1875870732064640:12345-192.168.202.9@tcp:101:stat.0 Request processed in 921us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970019.589467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 157 00000100:00100000:2.0:1788970019.663336:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970019.663460:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732064896 00000100:00100000:0.0:1788970019.663471:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732064896 00000100:00100000:0.0:1788970019.663557:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 158 00000100:00100000:0.0:1788970019.663567:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11445:x1875870732064896:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970019.663589:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970019.663610:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b45e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eaf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970019.663699:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788970019.663901:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b45e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf7 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.663915:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c500) 00010000:00010000:0.0:1788970019.663918:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970019.663923:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b45e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf7 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.663938:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485c00, rc 0) 00000100:00100000:0.0:1788970019.663989:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:11445:x1875870732064896:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 423us (663us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788970019.663996:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 158 00000100:00100000:0.0:1788970019.667526:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.667617:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732065152 00000100:00100000:2.0:1788970019.667628:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732065152 00000100:00100000:2.0:1788970019.667694:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:2.0:1788970019.667705:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:11445:x1875870732065152:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970019.668017:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11445:x1875870732065152:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 313us (500us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788970019.668024:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:1.0:1788970019.725629:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.725754:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732065408 00000100:00100000:2.0:1788970019.725781:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732065408 00000100:00100000:2.0:1788970019.725871:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 159 00000100:00100000:2.0:1788970019.725882:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11451:x1875870732065408:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970019.725907:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970019.725933:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b45ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eafe expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.726043:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.726057:0:7061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf0 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.726066:0:7061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.726120:0:7061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf0 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.726134:0:7061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf0 expref: 27 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970019.726146:0:7061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878949a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741500672:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970019.726241:0:7061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970019.731688:0:7061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878949a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741500672:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970019.731726:0:7061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970019.733460:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.733554:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732065536 00000100:00100000:2.0:1788970019.733564:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732065536 00010000:00010000:2.0:1788970019.733608:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf0 expref: 28 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970019.733653:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:2.0:1788970019.733663:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:2353:x1875870732065536:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970019.733676:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970019.733684:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf0 expref: 28 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.733697:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf0 expref: 28 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.733738:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b45d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eaf0 expref: 28 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.733756:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970019.733761:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.733771:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.733787:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.733853:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970019.733908:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:2353:x1875870732065536:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 245us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970019.733916:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 65 00010000:00010000:1.0:1788970019.734038:0:7061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.734046:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970019.734065:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788970019.734226:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b45ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eafe expref: 28 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.734243:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eafe expref: 27 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.734250:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:1.0:1788970019.734252:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970019.734254:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c800, rc 0) 00000100:00100000:1.0:1788970019.734281:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:11451:x1875870732065408:12345-192.168.202.9@tcp:101:bash.0 Request processed in 8402us (8663us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788970019.734288:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 159 00000100:00100000:3.0:1788970019.737642:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970019.737747:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732065792 00000100:00100000:0.0:1788970019.737758:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732065792 00000100:00100000:0.0:1788970019.737866:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 160 00000100:00100000:0.0:1788970019.737876:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:11451:x1875870732065792:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:0.0:1788970019.738153:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.738173:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.738200:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970019.738275:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788970019.738300:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000118cd0de reply state 0000000043e3e8e9 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970019.738309:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970019.738402:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:11451:x1875870732065792:12345-192.168.202.9@tcp:36:bash.0 Request processed in 528us (770us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788970019.738410:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 160 00000020:00080000:0.0:1788970019.738416:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788970019.741274:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.741298:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.741307:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.741313:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.741318:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.741357:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.741381:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970019.741386:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.741393:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.741402:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4603 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970019.745094:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970019.745309:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732065920 00000100:00100000:1.0:1788970019.745336:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732065920 00000100:00100000:1.0:1788970019.745400:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 161 00000100:00100000:1.0:1788970019.745410:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:11451:x1875870732065920:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1788970019.745436:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970019.745457:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b460a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb05 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.745543:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.745558:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eafe expref: 30 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.745566:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.745599:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eafe expref: 30 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.745615:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eafe expref: 30 pid: 7061 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970019.745629:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741500800:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970019.745718:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970019.748129:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741500800:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970019.748159:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970019.749171:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.750124:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732066048 00000100:00100000:2.0:1788970019.750134:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732066048 00010000:00010000:2.0:1788970019.750174:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eafe expref: 31 pid: 7061 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970019.750267:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:2.0:1788970019.750277:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:2353:x1875870732066048:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970019.750291:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970019.750297:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eafe expref: 31 pid: 7061 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.750311:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eafe expref: 31 pid: 7061 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.750333:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b45f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eafe expref: 31 pid: 7061 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.750373:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970019.750378:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.750389:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.750397:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.750431:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970019.750503:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:2353:x1875870732066048:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 228us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970019.750510:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 66 00010000:00010000:1.0:1788970019.750571:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.750587:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970019.750632:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788970019.750636:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970019.750655:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.750686:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b460a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb05 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.750701:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb05 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.750718:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:1.0:1788970019.750721:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970019.750724:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93600, rc 0) 00000100:00100000:1.0:1788970019.750748:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:11451:x1875870732065920:12345-192.168.202.9@tcp:101:bash.0 Request processed in 5341us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970019.750755:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 161 00000100:00100000:0.0:1788970019.753885:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.753986:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732066304 00000100:00100000:2.0:1788970019.753995:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732066304 00000100:00100000:2.0:1788970019.754045:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:2.0:1788970019.754055:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:11451:x1875870732066304:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:2.0:1788970019.754290:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:11451:x1875870732066304:12345-192.168.202.9@tcp:35:bash.0 Request processed in 236us (414us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788970019.754298:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:0.0:1788970019.848355:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.849408:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732066560 00000100:00100000:2.0:1788970019.849419:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732066560 00000100:00100000:2.0:1788970019.849475:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 162 00000100:00100000:2.0:1788970019.849482:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:11461:x1875870732066560:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970019.849505:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970019.849539:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb0c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970019.849627:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788970019.849934:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4618 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb0c expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.849944:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c500) 00010000:00010000:2.0:1788970019.849946:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970019.849950:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb0c expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.849962:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c800, rc 0) 00000100:00100000:2.0:1788970019.850012:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:11461:x1875870732066560:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 532us (1670us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788970019.850017:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 162 00000100:00100000:3.0:1788970019.851741:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.851950:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732066688 00000100:00100000:2.0:1788970019.851959:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732066688 00000100:00100000:2.0:1788970019.852013:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 163 00000100:00100000:2.0:1788970019.852021:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:11461:x1875870732066688:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:2.0:1788970019.852229:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852246:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852258:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852292:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852299:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852306:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852558:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852568:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852575:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970019.852617:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852629:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852633:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852639:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852643:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44cc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.852646:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852657:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852665:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970019.852667:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.852671:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852675:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4626 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852685:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852688:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852692:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852695:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44dc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.852696:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852699:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852703:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1400) 00010000:00010000:2.0:1788970019.852704:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.852705:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852715:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b462d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852725:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852728:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852732:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852735:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.852736:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852739:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852743:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970019.852744:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.852747:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.852750:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970019.853899:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:11461:x1875870732066688:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 1797us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970019.853912:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 163 00000100:00100000:0.0:1788970019.856253:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.856402:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732066944 00000100:00100000:2.0:1788970019.856410:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732066944 00000100:00100000:2.0:1788970019.856769:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:2.0:1788970019.856782:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:11461:x1875870732066944:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970019.857084:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:11461:x1875870732066944:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 306us (841us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788970019.857089:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:0.0:1788970019.898407:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970019.898501:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970019.898548:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970019.898586:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970019.898648:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732067456 00000100:00100000:0.0:1788970019.898659:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732067456 00000100:00100000:0.0:1788970019.898723:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 142 00000100:00100000:0.0:1788970019.898733:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732067456:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970019.898850:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2353:x1875870732067456:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 117us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970019.898857:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 142 00000100:00080000:0.0:1788970019.898877:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970019.899736:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732067328 00000100:00100000:1.0:1788970019.899745:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732067328 00000100:00100000:1.0:1788970019.899844:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732067200 00000100:00100000:1.0:1788970019.899848:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732067200 00000100:00100000:1.0:1788970019.899870:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:1.0:1788970019.899878:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732067328:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970019.899933:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732067328:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 56us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970019.899954:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:1.0:1788970019.899970:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:1.0:1788970019.899977:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732067200:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970019.900005:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732067200:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 29us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970019.900011:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00080000:0.0:1788970019.901455:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970019.905622:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732067072 00000100:00100000:3.0:1788970019.905638:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732067072 00000100:00100000:0.0:1788970019.905687:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970019.905695:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 290 00000100:00100000:3.0:1788970019.905705:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732067072:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970019.905974:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2353:x1875870732067072:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 269us (7944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970019.905982:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 290 00000100:00100000:2.0:1788970019.907599:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732067712 00000100:00100000:2.0:1788970019.907611:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732067712 00000100:00100000:2.0:1788970019.907677:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 164 00000100:00100000:2.0:1788970019.907687:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:11464:x1875870732067712:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970019.907710:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970019.907731:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b463b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb13 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.907845:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.907861:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.907873:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.907887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.907895:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.907922:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908483:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4650 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908495:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908503:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970019.908513:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788970019.908605:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908613:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908620:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908626:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44dc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.908631:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908637:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908648:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970019.908651:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.908666:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908673:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4642 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908687:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908693:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908699:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908704:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44cc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970019.908707:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908712:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908720:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1400) 00010000:00010000:2.0:1788970019.908722:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970019.908725:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908730:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.908774:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b463b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb13 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970019.909071:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970019.909160:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb13 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.909176:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970019.909178:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970019.909181:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c800, rc 0) 00000100:00100000:2.0:1788970019.909260:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11464:x1875870732067712:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1575us (3577us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788970019.909268:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 164 00000100:00100000:3.0:1788970019.913556:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970019.913619:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732067840 00000100:00100000:0.0:1788970019.913630:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732067840 00000100:00100000:0.0:1788970019.913729:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 165 00000100:00100000:0.0:1788970019.913740:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11464:x1875870732067840:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:0.0:1788970019.913849:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.913867:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.913879:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.913905:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.913912:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.913919:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.913926:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970019.913930:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.913937:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.913949:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:0.0:1788970019.913962:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970019.913968:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970019.913973:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b465e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970019.914065:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11464:x1875870732067840:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 325us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970019.914072:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 165 00000100:00100000:3.0:1788970019.915041:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970019.915118:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732067968 00000100:00100000:2.0:1788970019.915125:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732067968 00000100:00100000:2.0:1788970019.915169:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:2.0:1788970019.915178:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:2355:x1875870732067968:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970019.915193:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970019.915220:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4650 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb13 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970019.915236:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:2.0:1788970019.915240:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970019.915282:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:2355:x1875870732067968:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 105us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970019.915289:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:3.0:1788970019.920172:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970019.920280:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732068224 00000100:00100000:1.0:1788970019.920290:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732068224 00000100:00100000:1.0:1788970019.920359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:1.0:1788970019.920370:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+33:11464:x1875870732068224:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970019.920619:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11464:x1875870732068224:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 250us (456us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788970019.920626:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:3.0:1788970020.110728:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970020.113499:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732068480 00000100:00100000:1.0:1788970020.113514:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732068480 00000100:00100000:1.0:1788970020.113611:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 166 00000100:00100000:1.0:1788970020.113623:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11483:x1875870732068480:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:1.0:1788970020.113650:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970020.113673:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4665 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb1a expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970020.113779:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b466c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970020.113832:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b466c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970020.113863:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b466c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970020.113876:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788970020.114017:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4665 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb1a expref: 37 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970020.114038:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b466c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb1a expref: 36 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970020.114047:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:1.0:1788970020.114050:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788970020.114054:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93400, rc 0) 00000100:00100000:1.0:1788970020.114127:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11483:x1875870732068480:12345-192.168.202.9@tcp:101:cat.0 Request processed in 508us (3411us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788970020.114135:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 166 00000100:00100000:3.0:1788970020.152336:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970020.158053:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732068608 00000100:00100000:2.0:1788970020.158071:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732068608 00000100:00100000:2.0:1788970020.158146:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 167 00000100:00100000:2.0:1788970020.158172:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11484:x1875870732068608:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970020.158200:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970020.158253:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b467a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.158323:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.158347:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.158358:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970020.158391:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788970020.158395:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970020.158413:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.158441:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b467a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb21 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.158462:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb21 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.158472:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970020.158475:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970020.158478:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c400, rc 0) 00000100:00100000:2.0:1788970020.158556:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11484:x1875870732068608:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 386us (6230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970020.158574:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 167 00000100:00100000:3.0:1788970020.165463:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970020.165647:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732068992 00000100:00100000:1.0:1788970020.165658:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732068992 00000100:00100000:1.0:1788970020.165715:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:1.0:1788970020.165726:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11484:x1875870732068992:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970020.166122:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11484:x1875870732068992:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 397us (668us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788970020.166131:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:3.0:1788970020.170298:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970020.170522:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732069120 00000100:00100000:0.0:1788970020.170541:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732069120 00000100:00100000:0.0:1788970020.170611:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:0.0:1788970020.170622:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11484:x1875870732069120:12345-192.168.202.9@tcp:103:lfs.0 00010000:00010000:0.0:1788970020.170637:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788970020.170662:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb05 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970020.170689:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b466c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb1a expref: 37 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970020.170702:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4515 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eac6 expref: 36 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970020.170722:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977849672d00) 00010000:00010000:0.0:1788970020.170732:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970020.170843:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11484:x1875870732069120:12345-192.168.202.9@tcp:103:lfs.0 Request processed in 222us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970020.170869:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:3.0:1788970020.179911:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970020.180077:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732069248 00000100:00100000:2.0:1788970020.180088:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732069248 00000100:00100000:2.0:1788970020.180234:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 168 00000100:00100000:2.0:1788970020.180243:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11484:x1875870732069248:12345-192.168.202.9@tcp:58:lfs.0 00010000:00010000:2.0:1788970020.180342:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.180355:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.180363:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970020.180725:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788970020.180846:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11484:x1875870732069248:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 604us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970020.180853:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 168 00000100:00100000:3.0:1788970020.202657:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970020.202778:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732069376 00000100:00100000:2.0:1788970020.202831:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732069376 00000100:00100000:2.0:1788970020.202885:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:2.0:1788970020.202895:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11486:x1875870732069376:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970020.202918:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970020.202940:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b468f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb28 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.203276:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.203310:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.203322:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.203419:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.203428:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970020.203435:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.204464:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.204476:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.204485:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970020.204525:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788970020.204529:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970020.204549:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209362:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209386:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209393:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209401:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209407:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44dc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970020.209412:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209439:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209458:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:3.0:1788970020.209461:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970020.209478:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209485:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209503:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209509:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209515:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209520:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970020.209523:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209530:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.209537:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1200) 00010000:00010000:3.0:1788970020.209540:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970020.209543:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.211312:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b469d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.211381:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b468f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb28 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.211396:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb28 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970020.211404:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970020.211406:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970020.211409:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dde00, rc 0) 00000100:00100000:3.0:1788970020.212143:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11486:x1875870732069376:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 9245us (9494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970020.212153:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 169 00000100:00100000:1.0:1788970020.295251:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741500928:0@lo:400:kworker.0 00000100:00100000:1.0:1788970020.295334:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970020.295390:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741501440:0@lo:400:kworker.0 00000100:00100000:1.0:1788970020.295430:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970020.295463:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970020.295470:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741501312:0@lo:400:kworker.0 00000100:00100000:1.0:1788970020.295495:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970020.295526:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741501056:0@lo:400:kworker.0 00000100:00100000:1.0:1788970020.295548:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970020.295566:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741501568:0@lo:400:kworker.0 00000100:00100000:1.0:1788970020.295586:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970020.295604:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970020.295609:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741501184:0@lo:400:kworker.0 00000100:00100000:1.0:1788970020.295628:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970020.295657:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741501440 00000100:00100000:1.0:1788970020.295665:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741501440 00000100:00100000:1.0:1788970020.295722:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741501056 00000100:00100000:1.0:1788970020.295726:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741501056 00000100:00100000:1.0:1788970020.295739:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741501184 00000100:00100000:1.0:1788970020.295741:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741501184 00000100:00100000:1.0:1788970020.295756:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788970020.295764:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741501440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.295864:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741500928 00000100:00100000:0.0:1788970020.295869:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741500928 00000100:00100000:0.0:1788970020.295897:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788970020.295904:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741500928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.295967:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741500928:12345-0@lo:400:kworker.0 Request processed in 64us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970020.295974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788970020.296008:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788970020.296015:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741501056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.296048:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741501056:12345-0@lo:400:kworker.0 Request processed in 34us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970020.296054:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788970020.296068:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788970020.296073:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741501184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.296097:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741501184:12345-0@lo:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970020.296103:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788970020.296139:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741501312 00000100:00100000:0.0:1788970020.296144:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741501312 00000100:00100000:0.0:1788970020.296168:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741501568 00000100:00100000:0.0:1788970020.296171:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741501568 00000100:00100000:0.0:1788970020.296191:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788970020.296197:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741501312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.296236:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741501312:12345-0@lo:400:kworker.0 Request processed in 40us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970020.296250:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788970020.296261:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788970020.296266:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741501568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.296293:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741501568:12345-0@lo:400:kworker.0 Request processed in 27us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970020.296299:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788970020.296335:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970020.296338:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970020.296341:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970020.296364:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1788970020.296369:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1788970020.296390:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff977877fca1c0, transno 4294967307 00000100:00100000:0.0:1788970020.296401:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741501312:0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.296412:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741500928:0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.296746:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741501184:0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.296756:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741501056:0@lo:400:kworker.0 00000100:00100000:0.0:1788970020.296766:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741501568:0@lo:400:kworker.0 00000100:00100000:1.0:1788970020.297027:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741501440:12345-0@lo:400:kworker.0 Request processed in 1262us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970020.297034:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788970020.297194:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741501440:0@lo:400:kworker.0 00000100:00100000:3.0:1788970020.298441:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970020.298456:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784c14f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741501696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970020.298510:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970020.298550:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741501696 00000100:00100000:3.0:1788970020.298556:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741501696 00000100:00100000:3.0:1788970020.298600:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788970020.298608:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741501696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970020.298640:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788970020.298691:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741501696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970020.298698:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788970020.298748:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784c14f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741501696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788970020.932928:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970021.020831:0:12427:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970021.020842:0:12427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970021.020890:0:12427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788970021.020898:0:12427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788970021.062550:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970021.062561:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970021.062599:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788970021.062608:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788970021.062738:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f467480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741501824:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788970021.062874:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970021.084231:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970021.087719:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f467480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741501824:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788970021.088460:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732069504 00000100:00100000:3.0:1788970021.088471:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732069504 00000100:00100000:3.0:1788970021.088565:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 170 00000100:00100000:3.0:1788970021.088577:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11497:x1875870732069504:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000100:00080000:0.0:1788970021.088598:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:3.0:1788970021.088608:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788970021.088722:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11497:x1875870732069504:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 148us (4500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970021.088730:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 170 00000100:00100000:2.0:1788970021.101782:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970021.102018:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732069632 00000100:00100000:0.0:1788970021.102029:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732069632 00000100:00100000:0.0:1788970021.102090:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 171 00000100:00100000:0.0:1788970021.102117:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11497:x1875870732069632:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788970021.102213:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102233:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102247:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102265:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102272:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102287:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102314:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102324:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102331:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970021.102372:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788970021.102377:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970021.102392:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102413:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102419:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102426:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102431:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970021.102435:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102442:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102454:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:0.0:1788970021.102457:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970021.102463:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102468:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102482:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102488:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102493:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102503:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970021.102506:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102513:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102520:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff977849672d00) 00010000:00010000:0.0:1788970021.102523:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970021.102526:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102531:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102541:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102545:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102549:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102551:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970021.102553:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102556:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102567:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:0.0:1788970021.102569:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970021.102571:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.102574:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b46b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970021.102636:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11497:x1875870732069632:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 522us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970021.102644:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 171 00000100:00100000:0.0:1788970021.106574:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970021.106974:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732069888 00000100:00100000:0.0:1788970021.106984:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732069888 00000100:00100000:0.0:1788970021.107048:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 172 00000100:00100000:0.0:1788970021.107058:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11497:x1875870732069888:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970021.107080:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970021.107102:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b46c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb2f expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107217:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107234:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107245:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970021.107274:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788970021.107492:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107500:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107506:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107512:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970021.107516:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107523:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107534:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:0.0:1788970021.107537:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970021.107542:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107549:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107588:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b46c0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb2f expref: 38 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107598:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:0.0:1788970021.107601:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970021.107610:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b46c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb2f expref: 38 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.107619:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485400, rc 0) 00000100:00100000:0.0:1788970021.107683:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11497:x1875870732069888:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 626us (1122us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788970021.107691:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 172 00000100:00100000:2.0:1788970021.119060:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.119290:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732070016 00000100:00100000:3.0:1788970021.119301:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732070016 00000100:00100000:3.0:1788970021.119373:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 173 00000100:00100000:3.0:1788970021.119384:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11497:x1875870732070016:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788970021.119419:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788970021.119538:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778539b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11497:x1875870732070016:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 155us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970021.119546:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 173 00000100:00100000:3.0:1788970021.124505:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970021.124589:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732070272 00000100:00100000:0.0:1788970021.124600:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732070272 00000100:00100000:0.0:1788970021.124662:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 174 00000100:00100000:0.0:1788970021.124671:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11497:x1875870732070272:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970021.124695:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970021.124699:0:7061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788970021.124726:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb21 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.124748:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:0.0:1788970021.124754:0:7061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970021.124777:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb36 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788970021.125543:0:7061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788970021.125847:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.125862:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.125874:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.125939:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b46d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb36 expref: 39 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.125955:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb36 expref: 38 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.125962:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672d00) 00010000:00010000:0.0:1788970021.125965:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970021.125967:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485e00, rc 0) 00000100:00100000:0.0:1788970021.126030:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11497:x1875870732070272:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1360us (1535us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788970021.126038:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 174 00000100:00100000:0.0:1788970021.131307:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.131361:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732070528 00000100:00100000:3.0:1788970021.131374:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732070528 00000100:00100000:3.0:1788970021.131440:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 175 00000100:00100000:3.0:1788970021.131450:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11497:x1875870732070528:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788970021.131515:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970021.131545:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b46dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb36 expref: 38 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131585:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672d00) 00010000:00010000:3.0:1788970021.131597:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970021.131623:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131639:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131649:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131663:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131670:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131677:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131933:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131941:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131948:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131954:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970021.131958:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131972:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131980:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:3.0:1788970021.131983:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970021.131987:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.131993:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b46ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.132004:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.132009:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.132014:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.132020:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970021.132023:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.132028:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.132035:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x181ee545 (ffff977858b3ce00) 00010000:00010000:3.0:1788970021.132037:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970021.132040:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.132055:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b46f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x181ee545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970021.132140:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11497:x1875870732070528:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 691us (850us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788970021.132149:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 175 00000100:00100000:2.0:1788970021.140446:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970021.143474:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732070656 00000100:00100000:0.0:1788970021.143490:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732070656 00000100:00100000:0.0:1788970021.143571:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 176 00000100:00100000:0.0:1788970021.143582:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11497:x1875870732070656:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970021.143604:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970021.143628:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b46f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb3d expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.143667:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.143681:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.143715:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.143832:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485400/0x5d0de860b05b46f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb3d expref: 39 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.143854:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb3d expref: 38 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.143863:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:0.0:1788970021.143865:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788970021.143870:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485c00, rc 0) 00000100:00100000:0.0:1788970021.143937:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11497:x1875870732070656:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 358us (3503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970021.143945:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 176 00000100:00100000:2.0:1788970021.148769:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.148893:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732070912 00000100:00100000:3.0:1788970021.148903:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732070912 00000100:00100000:3.0:1788970021.148954:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 177 00000100:00100000:3.0:1788970021.148963:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11497:x1875870732070912:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788970021.149047:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.149064:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.149075:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970021.149369:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788970021.149378:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333112587415ns, next at 334112585524ns, rc = 0 00000004:00010000:3.0:1788970021.149456:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007131cc54 reply state 00000000bc66b2b9 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970021.149464:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970021.149560:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+40:11497:x1875870732070912:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 598us (809us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788970021.149568:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 177 00010000:00010000:3.0:1788970021.151633:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.151651:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.151660:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.151666:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970021.151671:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.151679:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.151705:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:3.0:1788970021.151709:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788970021.151714:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.151720:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4706 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970021.153616:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.153719:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732071040 00000100:00100000:3.0:1788970021.153728:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732071040 00000100:00100000:3.0:1788970021.153810:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 178 00000100:00100000:3.0:1788970021.153821:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787929cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+39:11497:x1875870732071040:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970021.153845:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970021.153865:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.153935:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb44 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.153950:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb44 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.153970:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:3.0:1788970021.153973:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970021.153977:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd400, rc 0) 00000100:00100000:3.0:1788970021.154043:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787929cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+40:11497:x1875870732071040:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 224us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970021.154050:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 178 00000100:00100000:2.0:1788970021.157891:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970021.161563:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732071168 00000100:00100000:0.0:1788970021.161578:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732071168 00000100:00100000:0.0:1788970021.161973:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:0.0:1788970021.161984:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2354:x1875870732071168:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788970021.162365:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970021.162412:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732071168:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 429us (4727us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788970021.162420:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:0.0:1788970021.175163:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.175819:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732071424 00000100:00100000:3.0:1788970021.175830:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732071424 00000100:00100000:3.0:1788970021.175891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:3.0:1788970021.175902:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+40:11497:x1875870732071424:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788970021.176136:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+41:11497:x1875870732071424:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 236us (983us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788970021.176145:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:0.0:1788970021.184488:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970021.184643:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732071680 00000100:00100000:1.0:1788970021.184657:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732071680 00000100:00100000:1.0:1788970021.184723:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 179 00000100:00100000:1.0:1788970021.184734:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+41:11497:x1875870732071680:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788970021.184904:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+41:11497:x1875870732071680:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 171us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970021.184921:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 179 00000100:00100000:2.0:1788970021.190836:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970021.191890:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732071808 00000100:00100000:1.0:1788970021.191903:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732071808 00000100:00100000:1.0:1788970021.191966:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 180 00000100:00100000:1.0:1788970021.191977:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865086580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+41:11497:x1875870732071808:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970021.191997:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970021.192017:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb4b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.192082:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b471b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.192096:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b471b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.192107:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b471b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970021.192144:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970021.192163:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b471b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.192190:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb4b expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.192216:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b471b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb4b expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.192225:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:1.0:1788970021.192236:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788970021.192240:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92400, rc 0) 00000100:00100000:1.0:1788970021.192316:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865086580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+42:11497:x1875870732071808:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 342us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970021.192324:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 180 00000100:00100000:0.0:1788970021.200696:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970021.200808:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732071936 00000100:00100000:2.0:1788970021.200818:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732071936 00000100:00100000:2.0:1788970021.200875:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:2.0:1788970021.200885:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732071936:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970021.200902:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970021.200922:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb52 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970021.200950:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa18425, blocks: 0x1 00010000:00010000:2.0:1788970021.200969:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1788970021.200974:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970021.200983:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb52 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.201002:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb52 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.201014:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d200, rc 0) 00000100:00100000:2.0:1788970021.201067:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2356:x1875870732071936:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 184us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970021.201074:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:0.0:1788970021.206312:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970021.206402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732072192 00000100:00100000:2.0:1788970021.206417:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732072192 00000100:00100000:2.0:1788970021.206477:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 181 00000100:00100000:2.0:1788970021.206488:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+42:11497:x1875870732072192:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788970021.206593:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+42:11497:x1875870732072192:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 107us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970021.206601:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 181 00000100:00100000:1.0:1788970021.214063:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970021.214138:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732072320 00000100:00100000:0.0:1788970021.214148:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732072320 00000100:00100000:0.0:1788970021.214215:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:0.0:1788970021.214226:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:11497:x1875870732072320:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970021.214245:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970021.214263:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb59 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.214307:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb52 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.214318:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970021.214323:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970021.214328:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.214362:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb52 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.214377:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb52 expref: 9 pid: 6676 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970021.214391:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f359a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1875870741501952:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970021.214484:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970021.223540:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.223617:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f359a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1875870741501952:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970021.223621:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732072448 00000100:00100000:1.0:1788970021.223628:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732072448 00010000:00010000:3.0:1788970021.223654:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.223664:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb52 expref: 10 pid: 6676 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.223674:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484a00, rc 0) 00000100:00100000:1.0:1788970021.223702:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:1.0:1788970021.223711:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:2354:x1875870732072448:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970021.223726:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970021.223747:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb52 expref: 10 pid: 6676 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970021.223755:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:11497:x1875870732072320:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 9533us (9702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970021.223770:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00010000:00010000:1.0:1788970021.223770:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb52 expref: 10 pid: 6676 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.223812:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000189921fd/0x5d0de860b05b4722 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb52 expref: 9 pid: 6676 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.223826:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970021.223831:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970021.223840:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.223858:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.223894:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970021.223908:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875870741502080:192.168.202.9@tcp:105: 00000100:00100000:1.0:1788970021.223961:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970021.233471:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970021.233585:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875870741502080:192.168.202.9@tcp:105: 00010000:00010000:1.0:1788970021.233611:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970021.233674:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2354:x1875870732072448:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 9963us (10142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970021.233686:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:3.0:1788970021.234629:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732072576 00000100:00100000:3.0:1788970021.234642:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732072576 00002000:00100000:3.0:1788970021.234962:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97787f359680 x1875870732072576/t0(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:552/0 lens 504/0 e 0 to 0 dl 1788970032 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970021.234974:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787f359680 with x1875870732072576 ext(0->8) 00002000:00010000:3.0:1788970021.234979:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787f359680 00000100:00100000:3.0:1788970021.235017:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1788970021.235027:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732072576:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788970021.236716:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:2353:x1875870732072576:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 Request processed in 1681us (3245us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788970021.236728:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00002000:00100000:3.0:1788970021.236739:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97787f359680 x1875870732072576/t4294967314(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:552/0 lens 504/448 e 0 to 0 dl 1788970032 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970021.236749:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787f359680 with x1875870732072576 ext(0->8) 00002000:00010000:3.0:1788970021.236755:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787f359680 00000100:00100000:0.0:1788970021.246537:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970021.246637:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732072704 00000100:00100000:2.0:1788970021.246647:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732072704 00000100:00100000:2.0:1788970021.246725:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 182 00000100:00100000:2.0:1788970021.246736:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+42:11497:x1875870732072704:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788970021.303106:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+42:11497:x1875870732072704:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 56360us (56568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970021.303120:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 182 00000001:00080000:1.0:1788970021.305255:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:1.0:1788970021.305316:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788970021.305366:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788970021.305380:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:1.0:1788970021.305975:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1788970021.305990:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1788970021.306385:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970021.306408:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741502208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788970021.306494:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970021.306575:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741502208 00000100:00100000:2.0:1788970021.306584:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741502208 00000100:00100000:2.0:1788970021.306640:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788970021.306649:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741502208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788970021.306834:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788970021.306837:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788970021 00002000:00010000:2.0:1788970021.306839:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788970021.306841:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788970021 -> 1788970021 00002000:00010000:2.0:1788970021.306843:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788970021.306876:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741502208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (384us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788970021.306886:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1788970021.306927:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9778812e0780/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788970021.306932:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741502208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788970021.310240:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.310323:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732072832 00000100:00100000:3.0:1788970021.310333:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732072832 00000100:00100000:3.0:1788970021.310403:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1788970021.310414:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:2354:x1875870732072832:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788970021.338830:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788970021.338848:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1788970021.338854:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1788970021.341201:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732072832:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 30769us (30951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970021.341215:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:2.0:1788970021.347157:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970021.347239:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732073088 00000100:00100000:1.0:1788970021.347249:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732073088 00000100:00100000:1.0:1788970021.347307:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 183 00000100:00100000:1.0:1788970021.347318:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:11497:x1875870732073088:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970021.347372:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970021.347397:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b471b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb4b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.347431:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:1.0:1788970021.347437:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970021.347466:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.347478:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.347486:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970021.347727:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002eef1548 reply state 0000000017c2de9f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970021.347736:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970021.347869:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11497:x1875870732073088:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 551us (721us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788970021.347876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 183 00000100:00100000:3.0:1788970021.351489:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970021.352161:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732073216 00000100:00100000:1.0:1788970021.352172:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732073216 00000100:00100000:1.0:1788970021.352279:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:1.0:1788970021.352291:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732073216:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788970021.353060:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788970021.353066:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788970021 -> 1788970020 00002000:00010000:1.0:1788970021.353070:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788970018 00002000:00010000:1.0:1788970021.353072:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788970021 -> 1788970020 00002000:00010000:1.0:1788970021.353074:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788970021.353226:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732073216:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 935us (1746us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788970021.353236:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00010000:00010000:0.0:1788970021.353656:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.353667:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.353675:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.353681:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970021.353685:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.353693:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.353719:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:0.0:1788970021.353722:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970021.353728:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.353734:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4730 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970021.356437:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.356532:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732073472 00000100:00100000:3.0:1788970021.356543:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732073472 00000100:00100000:3.0:1788970021.356641:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 184 00000100:00100000:3.0:1788970021.356652:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:11497:x1875870732073472:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788970021.356733:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.356751:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb3d expref: 18 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.356769:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.356828:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb3d expref: 18 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.356843:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb3d expref: 18 pid: 7061 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970021.356857:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784c14cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741502336:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970021.356935:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970021.359475:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.359589:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784c14cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741502336:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970021.359618:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970021.359701:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732073600 00000100:00100000:2.0:1788970021.359709:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732073600 00010000:00010000:2.0:1788970021.359745:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb3d expref: 19 pid: 7061 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970021.360011:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:2.0:1788970021.360022:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851af3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:2354:x1875870732073600:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970021.360038:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970021.360045:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb3d expref: 19 pid: 7061 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.360058:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb3d expref: 19 pid: 7061 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.360079:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b46ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb3d expref: 19 pid: 7061 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.360095:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:2.0:1788970021.360100:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.360109:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.360129:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.360160:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970021.360230:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851af3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:2354:x1875870732073600:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 209us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970021.360238:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 68 00010000:00010000:3.0:1788970021.360369:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.360377:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.360420:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.360428:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.360434:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.360440:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970021.360444:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.360452:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.360461:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:3.0:1788970021.360464:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788970021.360468:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.360473:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b4737 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970021.360515:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:11497:x1875870732073472:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 Request processed in 3864us (4092us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788970021.360523:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 184 00000100:00100000:0.0:1788970021.364077:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970021.364187:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732073728 00000100:00100000:1.0:1788970021.364207:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732073728 00000100:00100000:1.0:1788970021.364306:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:1.0:1788970021.364318:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2356:x1875870732073728:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788970021.364364:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.364385:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.364393:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970021.364398:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970021.364403:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.364438:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.364453:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 8 pid: 6679 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970021.364466:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1875870741502464:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970021.364600:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788970021.368475:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970021.369039:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732073856 00000100:00100000:0.0:1788970021.369051:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732073856 00010000:00010000:0.0:1788970021.369097:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 9 pid: 6679 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970021.369144:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:0.0:1788970021.369154:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2354:x1875870732073856:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970021.369169:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970021.369200:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 9 pid: 6679 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.369215:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 9 pid: 6679 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.369240:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970021.369244:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970021.369251:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.369261:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.369280:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970021.369337:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2354:x1875870732073856:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 184us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970021.369344:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00010000:00010000:1.0:1788970021.370979:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fc0f47e/0x5d0de860b05b4729 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb59 expref: 8 pid: 6679 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970021.371004:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1875870741502464:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970021.371031:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.371044:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.371051:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.371084:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.371093:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.371101:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.371109:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970021.371113:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.371144:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.371162:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.371170:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b473e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970021.371385:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732073728:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 7068us (7316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970021.371396:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:2.0:1788970021.373620:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970021.373723:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732074112 00000100:00100000:1.0:1788970021.373733:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732074112 00000100:00100000:1.0:1788970021.373859:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 185 00000100:00100000:1.0:1788970021.373872:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+17:11497:x1875870732074112:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788970021.373957:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.373977:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.373989:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.374250:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.374279:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb44 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.374287:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.374325:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb44 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.374340:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb44 expref: 18 pid: 5832 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970021.374355:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741502592:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970021.374551:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788970021.378187:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970021.378265:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732074240 00000100:00100000:2.0:1788970021.378275:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732074240 00010000:00010000:2.0:1788970021.378314:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb44 expref: 19 pid: 5832 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970021.378352:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:2.0:1788970021.378362:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:2353:x1875870732074240:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970021.378379:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970021.378386:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb44 expref: 19 pid: 5832 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.378399:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb44 expref: 19 pid: 5832 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.378422:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:2.0:1788970021.378428:0:11142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.378456:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.378464:0:11142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.378484:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970021.379030:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b470d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb44 expref: 19 pid: 5832 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970021.379049:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741502592:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970021.379070:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.379079:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.379085:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970021.379281:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788970021.379434:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788970021.379468:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788970021.379532:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875870741502720:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788970021.379580:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970021.379613:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff977841254b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970021.379704:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:2353:x1875870732074240:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1343us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970021.379713:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:2.0:1788970021.379739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741502720 00000100:00100000:2.0:1788970021.379743:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741502720 00000100:00100000:2.0:1788970021.379776:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970021.379782:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875870741502720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788970021.379861:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875870741502720:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970021.379868:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970021.379903:0:5833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788970021.379908:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9778812e0780, transno 4294967315 00000100:00100000:2.0:1788970021.379918:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875870741502720:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788970021.380306:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788970021.380360:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875870741502848:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788970021.380394:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970021.380410:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970021.380588:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741502848 00000100:00100000:2.0:1788970021.380593:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741502848 00000100:00100000:2.0:1788970021.380624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970021.380638:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875870741502848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788970021.380778:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875870741502848:12345-0@lo:1000:mdt00_001.0 Request processed in 141us (382us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788970021.380785:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970021.380835:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875870741502848:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788970021.380862:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380871:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380877:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380882:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970021.380886:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380893:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380906:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977849672100) 00010000:00010000:1.0:1788970021.380909:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970021.380914:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380920:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b474c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380948:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380962:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380967:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380971:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970021.380975:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380980:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380988:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:1.0:1788970021.380990:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970021.380993:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.380997:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b4688 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.381645:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.381663:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb28 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.381670:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.381693:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb28 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.381716:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb28 expref: 21 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970021.381730:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a0780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741502976:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970021.381869:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff977841254b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970021.383674:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970021.383756:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732074368 00000100:00100000:0.0:1788970021.383765:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732074368 00010000:00010000:0.0:1788970021.383845:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb28 expref: 22 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970021.383882:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:0.0:1788970021.383892:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:2354:x1875870732074368:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788970021.383906:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a0780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741502976:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970021.383907:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970021.383913:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb28 expref: 22 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.383926:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb28 expref: 22 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.383994:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.384242:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b46a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb28 expref: 22 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.384258:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:0.0:1788970021.384264:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.384272:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.384279:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970021.384308:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970021.384365:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:2354:x1875870732074368:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 474us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970021.384387:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 71 00010000:00010000:2.0:1788970021.384446:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384454:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384468:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384474:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384481:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384486:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970021.384490:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384499:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384507:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970021.384515:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970021.384520:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384525:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b4753 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384536:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384542:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384547:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384552:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970021.384555:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384560:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384569:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970021.384571:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970021.384574:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970021.384579:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4745 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970021.385516:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970021.385524:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788970021.385556:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:11497:x1875870732074112:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 11683us (11939us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788970021.385576:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 185 00000020:00080000:2.0:1788970021.385582:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788970021.386372:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788970021.386385:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788970021.387187:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970021.387330:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732074624 00000100:00100000:3.0:1788970021.387338:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732074624 00000100:00100000:3.0:1788970021.387382:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:3.0:1788970021.387391:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:11497:x1875870732074624:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788970021.388356:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788970021.388438:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788970021.388476:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.388490:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.388498:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.388505:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.388510:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.388514:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970021.388535:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788970021.388629:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:11497:x1875870732074624:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 1239us (1444us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788970021.388636:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000020:00080000:3.0:1788970021.388640:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788970021.388738:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970021.388745:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.388752:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970021.388756:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.388771:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.388781:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff977858b3ca00) 00010000:00010000:1.0:1788970021.388783:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788970021.388853:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.388858:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b475a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970021.388870:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970021.388871:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970021.388877:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970021.958149:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970022.912710:0:12480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970022.912721:0:12480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970022.912781:0:12480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788970022.912786:0:12480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788970022.992036:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970023.084869:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.084998:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732074880 00000100:00100000:1.0:1788970023.085009:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732074880 00000100:00100000:1.0:1788970023.085085:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 186 00000100:00100000:1.0:1788970023.085096:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:11515:x1875870732074880:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970023.085121:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970023.085141:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4761 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb60 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.085251:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b4768 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.085267:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b4768 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.085280:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b4768 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970023.085291:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788970023.085413:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4761 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb60 expref: 25 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.085432:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b4768 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb60 expref: 24 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.085440:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970023.085443:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970023.085447:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92600, rc 0) 00000100:00100000:1.0:1788970023.085509:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11515:x1875870732074880:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 415us (650us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788970023.085530:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 186 00000100:00080000:3.0:1788970023.085665:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970023.096982:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.099966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732075008 00000100:00100000:2.0:1788970023.099982:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732075008 00000100:00100000:2.0:1788970023.100079:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 187 00000100:00100000:2.0:1788970023.100089:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11515:x1875870732075008:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:2.0:1788970023.100165:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100191:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100205:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100220:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100226:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100233:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100464:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100483:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100491:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970023.100533:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100546:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100553:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100559:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100565:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44dc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.100569:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100577:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100589:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970023.100592:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.100597:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100603:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100623:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100630:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100636:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100641:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44ce00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.100644:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100649:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100657:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1400) 00010000:00010000:2.0:1788970023.100659:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.100662:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100667:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b477d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100696:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100703:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100708:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100720:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.100723:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100730:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100739:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1700) 00010000:00010000:2.0:1788970023.100741:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.100743:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.100749:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970023.100867:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11515:x1875870732075008:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 777us (3892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970023.100875:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 187 00000100:00100000:3.0:1788970023.164068:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.165501:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732075264 00000100:00100000:2.0:1788970023.165516:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732075264 00000100:00100000:2.0:1788970023.165592:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 188 00000100:00100000:2.0:1788970023.165603:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11518:x1875870732075264:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970023.165626:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970023.165649:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b478b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb67 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.165748:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.165980:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166165:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166194:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166203:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166210:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166556:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166565:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166573:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970023.166584:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788970023.166674:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166695:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166703:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166715:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44ce00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.166720:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166728:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166740:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970023.166743:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.166749:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166755:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166769:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166776:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.166782:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.167359:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44dc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.167365:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.167375:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.167396:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1700) 00010000:00010000:2.0:1788970023.167400:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.167403:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.167410:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44dc00/0x5d0de860b05b4799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.167461:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b478b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb67 expref: 27 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.167477:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb67 expref: 26 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.167485:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970023.167487:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970023.167490:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44cc00, rc 0) 00000100:00100000:2.0:1788970023.168470:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11518:x1875870732075264:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 2861us (4402us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788970023.168481:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 188 00000100:00100000:0.0:1788970023.177429:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.178166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732075392 00000100:00100000:2.0:1788970023.178186:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732075392 00000100:00100000:2.0:1788970023.178249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 189 00000100:00100000:2.0:1788970023.178261:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11518:x1875870732075392:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:2.0:1788970023.178338:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.178356:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.178376:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.178405:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.178413:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.178420:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.178427:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.178432:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.178439:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.178451:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970023.178455:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970023.178460:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.178467:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970023.178543:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11518:x1875870732075392:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 284us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970023.178551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 189 00000100:00100000:0.0:1788970023.183673:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.183847:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732075648 00000100:00100000:2.0:1788970023.183865:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732075648 00000100:00100000:2.0:1788970023.183983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:2.0:1788970023.183997:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11518:x1875870732075648:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970023.184257:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:11518:x1875870732075648:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 265us (596us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788970023.184264:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:1.0:1788970023.221335:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.221423:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732075904 00000100:00100000:3.0:1788970023.221434:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732075904 00000100:00100000:3.0:1788970023.221500:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 190 00000100:00100000:3.0:1788970023.221511:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:11044:x1875870732075904:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1788970023.221535:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970023.221556:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb6e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.221655:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.221672:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb67 expref: 28 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.221692:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.221725:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb67 expref: 28 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.221751:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb67 expref: 28 pid: 7061 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970023.221766:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784c14cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741503104:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970023.222376:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970023.227389:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.227493:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732076032 00000100:00100000:2.0:1788970023.227502:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732076032 00010000:00010000:2.0:1788970023.227546:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb67 expref: 29 pid: 7061 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970023.227594:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:2.0:1788970023.227603:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:2353:x1875870732076032:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970023.227618:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970023.227625:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb67 expref: 29 pid: 7061 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.227639:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb67 expref: 29 pid: 7061 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.227660:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970023.227666:0:11142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.227681:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.227688:0:11142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.227722:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970023.227830:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:2353:x1875870732076032:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 228us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970023.227838:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 72 00010000:00010000:3.0:1788970023.228713:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b47a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb67 expref: 28 pid: 7061 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970023.228918:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784c14cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741503104:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970023.228943:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.228953:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.228959:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970023.228979:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788970023.229124:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb6e expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.229140:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb6e expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.229148:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970023.229265:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788970023.229269:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc600, rc 0) 00000100:00100000:3.0:1788970023.229360:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:11044:x1875870732075904:12345-192.168.202.9@tcp:101:bash.0 Request processed in 7851us (8036us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788970023.229367:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 190 00000100:00100000:0.0:1788970023.232189:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.232307:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732076288 00000100:00100000:2.0:1788970023.232318:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732076288 00000100:00100000:2.0:1788970023.232412:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 191 00000100:00100000:2.0:1788970023.232423:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:11044:x1875870732076288:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:2.0:1788970023.232691:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.232708:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.232721:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970023.232844:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788970023.232872:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032f5aab0 reply state 00000000fec409b4 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970023.232883:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788970023.232933:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788970023.233032:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:11044:x1875870732076288:12345-192.168.202.9@tcp:36:bash.0 Request processed in 611us (862us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788970023.233040:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 191 00000020:00080000:2.0:1788970023.233045:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788970023.235308:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1788970023.235349:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.235362:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.235385:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.235391:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970023.235395:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.235403:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.235418:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970023.235421:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970023.235426:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.235432:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b47ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.236543:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732076416 00000100:00100000:0.0:1788970023.236556:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732076416 00000100:00100000:0.0:1788970023.236654:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 192 00000100:00100000:0.0:1788970023.236665:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:11044:x1875870732076416:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970023.236700:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970023.236718:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b47d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb75 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.237063:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b47d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb75 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.237080:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b47d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb75 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.237099:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:0.0:1788970023.237102:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970023.237105:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485a00, rc 0) 00000100:00100000:0.0:1788970023.237163:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:11044:x1875870732076416:12345-192.168.202.9@tcp:101:bash.0 Request processed in 500us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970023.237170:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 192 00000100:00100000:1.0:1788970023.239555:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.239646:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732076544 00000100:00100000:2.0:1788970023.239655:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732076544 00000100:00100000:2.0:1788970023.240005:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:2.0:1788970023.240017:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:11044:x1875870732076544:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970023.240032:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970023.240051:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb7c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970023.240075:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa18424, atime: 0x6aa18422, ctime: 0x6aa18424, blocks: 0xb 00010000:00010000:2.0:1788970023.240098:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1788970023.240103:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970023.240110:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb7c expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.240127:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb7c expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.240139:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44dc00, rc 0) 00000100:00100000:2.0:1788970023.240205:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:11044:x1875870732076544:12345-192.168.202.9@tcp:101:bash.0 Request processed in 191us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970023.240212:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00080000:3.0:1788970023.240243:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970023.242088:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.242204:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732076672 00000100:00100000:3.0:1788970023.242214:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732076672 00002000:00010000:3.0:1788970023.242250:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788970023.242256:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff977877fca1c0 with x1875870732076672 ext(0->18446744073709551615) 00002000:00010000:3.0:1788970023.242266:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff977877fca1c0. 00000100:00100000:3.0:1788970023.242301:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:3.0:1788970023.242311:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2354:x1875870732076672:12345-192.168.202.9@tcp:10:bash.0 00002000:00010000:3.0:1788970023.242588:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788970023.242592:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788970020 -> 1788970023 00002000:00010000:3.0:1788970023.242594:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788970018 -> 1788970018 00002000:00010000:3.0:1788970023.242604:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788970020 -> 1788970023 00002000:00010000:3.0:1788970023.242607:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788970023.242661:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2354:x1875870732076672:12345-192.168.202.9@tcp:10:bash.0 Request processed in 351us (580us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788970023.242668:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00002000:00010000:3.0:1788970023.242672:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788970023.242688:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff977877fca1c0 with x1875870732076672 ext(0->18446744073709551615) 00002000:00010000:3.0:1788970023.242695:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff977877fca1c0. 00000100:00100000:0.0:1788970023.295574:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.295683:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732076800 00000100:00100000:3.0:1788970023.295694:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732076800 00000100:00100000:3.0:1788970023.295771:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 193 00000100:00100000:3.0:1788970023.295783:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:11532:x1875870732076800:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:3.0:1788970023.295890:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.295906:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.295918:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.295934:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.295942:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.295948:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296228:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296239:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296252:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970023.296297:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296309:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296316:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296323:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296329:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970023.296333:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296342:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296353:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:3.0:1788970023.296356:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970023.296361:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296374:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b47df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296390:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296396:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296401:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296406:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970023.296409:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296415:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296423:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977858b3ce00) 00010000:00010000:3.0:1788970023.296426:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970023.296429:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296435:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b47e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296451:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296457:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296468:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296474:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970023.296477:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296484:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296491:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970023.296493:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970023.296496:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.296502:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b47ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970023.296578:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:11532:x1875870732076800:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 798us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970023.296587:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 193 00000100:00100000:0.0:1788970023.332022:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.332140:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732077056 00000100:00100000:2.0:1788970023.332152:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732077056 00000100:00100000:2.0:1788970023.332230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 194 00000100:00100000:2.0:1788970023.332241:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+32:11535:x1875870732077056:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970023.332266:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970023.332288:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b47f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb83 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332384:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332399:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332411:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332425:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332432:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332438:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332708:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332718:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332725:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970023.332734:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788970023.332901:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332910:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332924:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332930:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.332935:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332943:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332960:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970023.332964:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.332968:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332974:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b47fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332989:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.332995:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.333001:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.333006:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.333009:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.333025:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.333033:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1c00) 00010000:00010000:2.0:1788970023.333036:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.333039:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.333045:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.333094:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b47f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb83 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.333109:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb83 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.333118:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970023.333120:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788970023.333122:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d600, rc 0) 00000100:00100000:2.0:1788970023.333195:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11535:x1875870732077056:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 957us (1184us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788970023.333203:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 194 00000100:00100000:0.0:1788970023.336371:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.336466:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732077184 00000100:00100000:3.0:1788970023.336475:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732077184 00000100:00100000:3.0:1788970023.336534:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 195 00000100:00100000:3.0:1788970023.336545:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11535:x1875870732077184:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:3.0:1788970023.336613:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.336629:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb6e expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.336653:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.336689:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb6e expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.336704:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb6e expref: 34 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970023.336719:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784c14cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741503232:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970023.336858:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970023.340208:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.340286:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732077440 00000100:00100000:1.0:1788970023.340295:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732077440 00000100:00100000:1.0:1788970023.340354:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:1.0:1788970023.340365:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:5596:x1875870732077440:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788970023.340981:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:5596:x1875870732077440:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 616us (779us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788970023.340990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:3.0:1788970023.341625:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784c14cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741503232:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970023.341655:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.343652:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.343823:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732077568 00000100:00100000:1.0:1788970023.343835:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732077568 00010000:00010000:1.0:1788970023.343875:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb6e expref: 36 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.343913:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:1.0:1788970023.343923:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:2354:x1875870732077568:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970023.343937:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970023.343944:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb6e expref: 36 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.343956:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb6e expref: 36 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.343994:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b47bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb6e expref: 36 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.344011:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:1.0:1788970023.344016:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.344026:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.344034:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.344066:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970023.344275:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.344284:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.344315:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.344323:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.344329:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.344343:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970023.344347:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.344355:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.344364:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970023.344367:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970023.344371:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.344377:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.344674:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:2354:x1875870732077568:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 750us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970023.344691:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:3.0:1788970023.345439:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11535:x1875870732077184:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 8892us (9072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970023.345449:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 195 00000100:00100000:0.0:1788970023.347479:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.347564:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732077824 00000100:00100000:2.0:1788970023.347573:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732077824 00000100:00100000:2.0:1788970023.347625:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:2.0:1788970023.347641:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+34:11535:x1875870732077824:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970023.347975:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11535:x1875870732077824:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 340us (502us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788970023.347983:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:2.0:1788970023.420777:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.420917:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732078080 00000100:00100000:0.0:1788970023.420928:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732078080 00000100:00100000:0.0:1788970023.420991:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 196 00000100:00100000:0.0:1788970023.421007:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+35:11546:x1875870732078080:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:0.0:1788970023.421032:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970023.421053:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b481e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb8a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421123:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421136:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421148:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421161:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421167:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421184:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421459:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421468:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421474:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970023.421484:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788970023.421587:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421594:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421599:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421605:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970023.421608:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421615:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421626:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:0.0:1788970023.421629:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970023.421634:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421649:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4825 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421663:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421669:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421674:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421678:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970023.421681:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421686:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421692:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977849672800) 00010000:00010000:0.0:1788970023.421695:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970023.421697:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421702:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b482c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421743:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b481e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb8a expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421756:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb8a expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.421769:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:0.0:1788970023.421772:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970023.421774:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484e00, rc 0) 00000100:00100000:0.0:1788970023.422016:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11546:x1875870732078080:12345-192.168.202.9@tcp:101:cat.0 Request processed in 1011us (1257us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788970023.422024:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 196 00000100:00100000:1.0:1788970023.428024:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.428120:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732078336 00000100:00100000:2.0:1788970023.428130:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732078336 00000100:00100000:2.0:1788970023.428199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:2.0:1788970023.428210:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11546:x1875870732078336:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:2.0:1788970023.428467:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11546:x1875870732078336:12345-192.168.202.9@tcp:35:cat.0 Request processed in 259us (452us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788970023.428475:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 54 00000040:00080000:3.0:1788970023.428961:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970023.428967:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970023.429141:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788970023.429149:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788970023.449702:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.450709:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732078592 00000100:00100000:1.0:1788970023.450722:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732078592 00000100:00100000:1.0:1788970023.450817:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 197 00000100:00100000:1.0:1788970023.450828:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11547:x1875870732078592:12345-192.168.202.9@tcp:36:rm.0 00010000:00010000:1.0:1788970023.450884:0:7061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788970023.450911:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b4833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb8a expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.450930:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb83 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.450964:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b47d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb75 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.450974:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff977851ac1400) 00010000:00010000:1.0:1788970023.450984:0:7061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970023.451006:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.451019:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.451028:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.451043:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.451051:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.451057:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.451333:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.451341:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.451348:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970023.451933:0:7061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1788970023.451945:0:7061:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335415155172ns, next at 336415151333ns, rc = 0 00010000:00010000:1.0:1788970023.452008:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452017:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452024:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452031:0:7061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452037:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452043:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452457:0:7061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970023.452481:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452488:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452495:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452500:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970023.452514:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452521:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452531:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9778519ab900) 00010000:00010000:1.0:1788970023.452534:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788970023.452538:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452544:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b484f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452562:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452568:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452573:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452578:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970023.452580:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452585:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452593:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970023.452595:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970023.452604:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.452610:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4841 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970023.452621:0:7061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000191a8ed0 reply state 00000000bbd0870d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.452629:0:7061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970023.452913:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+37:11547:x1875870732078592:12345-192.168.202.9@tcp:36:rm.0 Request processed in 2083us (3217us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788970023.452922:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 197 00010000:00010000:0.0:1788970023.456112:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970023.456129:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.456142:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970023.456146:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.456156:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.456182:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9778519ab900) 00010000:00010000:0.0:1788970023.456186:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788970023.456191:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.456197:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4856 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.456227:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970023.456229:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970023.456231:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970023.462668:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.462700:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.462709:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.462716:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.462722:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.462730:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.462756:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9778519ab600) 00010000:00010000:2.0:1788970023.462783:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.462820:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.462828:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4848 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970023.498655:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.498775:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732078848 00000100:00100000:3.0:1788970023.498785:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732078848 00000100:00100000:0.0:1788970023.498922:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 198 00000100:00100000:0.0:1788970023.498957:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+36:11553:x1875870732078848:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970023.498986:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970023.499013:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b485d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb91 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.499131:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.499146:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.499156:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.499171:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.499186:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.499193:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788970023.499769:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788970023.499968:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.499979:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.499988:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.500037:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.500044:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.500051:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.500057:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970023.500062:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.500069:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.500082:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:0.0:1788970023.500086:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970023.500092:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.500098:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4864 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970023.500113:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041b4dae5 reply state 00000000c62f4c3e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.500122:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788970023.500155:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b485d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb91 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.500196:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb91 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.500206:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672a00) 00010000:00010000:0.0:1788970023.500209:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970023.500212:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484a00, rc 0) 00000100:00100000:0.0:1788970023.500299:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+39:11553:x1875870732078848:12345-192.168.202.9@tcp:101:bash.0 Request processed in 1346us (1660us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788970023.500308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 198 00010000:00010000:1.0:1788970023.505264:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.505282:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.505290:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.505297:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970023.505301:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.505308:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.505325:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977849672800) 00010000:00010000:1.0:1788970023.505328:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970023.505332:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.505357:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b486b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970023.505841:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.506142:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732078976 00000100:00100000:0.0:1788970023.506158:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732078976 00000100:00100000:0.0:1788970023.506236:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:0.0:1788970023.506246:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2353:x1875870732078976:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970023.506265:0:8534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970023.506284:0:8534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb98 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970023.506312:0:8534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970023.506332:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1788970023.506337:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970023.506345:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb98 expref: 6 pid: 8534 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.506362:0:8534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb98 expref: 6 pid: 8534 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.506390:0:8534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485800, rc 0) 00000100:00100000:0.0:1788970023.506455:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732078976:12345-192.168.202.9@tcp:101:bash.0 Request processed in 210us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970023.506463:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00080000:3.0:1788970023.506848:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970023.510111:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.510443:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732079104 00000100:00100000:1.0:1788970023.510455:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732079104 00000100:00100000:1.0:1788970023.510558:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:1.0:1788970023.510569:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:11553:x1875870732079104:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:1.0:1788970023.510589:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970023.510608:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eb9f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.510643:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb98 expref: 7 pid: 8534 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.510653:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970023.510660:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970023.510664:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.510705:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb98 expref: 7 pid: 8534 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.510719:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb98 expref: 7 pid: 8534 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.510733:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875870741503360:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970023.511051:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970023.514708:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.514924:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732079232 00000100:00100000:0.0:1788970023.514934:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732079232 00010000:00010000:0.0:1788970023.514975:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb98 expref: 8 pid: 8534 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.515019:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:0.0:1788970023.515032:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732079232:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970023.515051:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970023.515076:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb98 expref: 8 pid: 8534 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.515090:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb98 expref: 8 pid: 8534 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.515116:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970023.515120:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970023.515129:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.515140:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.515204:0:11142:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.515220:0:11142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778787cad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11142:1875870741503488:192.168.202.9@tcp:105: 00000100:00100000:0.0:1788970023.515305:0:11142:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970023.517268:0:11142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778787cad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11142:1875870741503488:192.168.202.9@tcp:105: 00010000:00010000:3.0:1788970023.517295:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970023.517350:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2353:x1875870732079232:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 2321us (2653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970023.517372:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 74 00010000:00010000:1.0:1788970023.522655:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4880 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb98 expref: 7 pid: 8534 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.522692:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875870741503360:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970023.522724:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.522747:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93600, rc 0) 00000100:00100000:1.0:1788970023.522858:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:11553:x1875870732079104:12345-192.168.202.9@tcp:101:bash.0 Request processed in 12291us (12757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970023.522867:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:0.0:1788970023.526148:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.526243:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732079488 00000100:00100000:1.0:1788970023.526254:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732079488 00000100:00100000:1.0:1788970023.526315:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:1.0:1788970023.526324:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+38:11553:x1875870732079488:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:1.0:1788970023.526688:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+39:11553:x1875870732079488:12345-192.168.202.9@tcp:35:bash.0 Request processed in 364us (550us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788970023.526696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1788970023.681944:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.682095:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732079616 00000100:00100000:0.0:1788970023.682107:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732079616 00000100:00100000:0.0:1788970023.682191:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 199 00000100:00100000:0.0:1788970023.682202:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+39:11569:x1875870732079616:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970023.682227:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970023.682250:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b488e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eba6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.682322:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.682338:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.682350:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970023.682387:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788970023.682391:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970023.682411:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.682452:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b488e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eba6 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.682473:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eba6 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.682482:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:0.0:1788970023.682486:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970023.682489:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485200, rc 0) 00000100:00100000:0.0:1788970023.682557:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+40:11569:x1875870732079616:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 357us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970023.682565:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 199 00000100:00100000:0.0:1788970023.687160:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.687218:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732079872 00000100:00100000:2.0:1788970023.687230:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732079872 00000100:00100000:2.0:1788970023.687299:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 200 00000100:00100000:2.0:1788970023.687308:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+40:11569:x1875870732079872:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970023.687329:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970023.687350:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b489c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.687451:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b48a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.687465:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b48a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.687476:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b48a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970023.687485:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788970023.687609:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b489c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebad expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.687647:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b48a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebad expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.687655:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672a00) 00010000:00010000:2.0:1788970023.687658:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970023.687662:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44ca00, rc 0) 00000100:00100000:2.0:1788970023.687745:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+42:11569:x1875870732079872:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 431us (589us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788970023.687751:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 200 00000100:00100000:2.0:1788970023.691474:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.691579:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732080128 00000100:00100000:0.0:1788970023.691589:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732080128 00000100:00100000:0.0:1788970023.691652:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 201 00000100:00100000:0.0:1788970023.691669:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+42:11569:x1875870732080128:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970023.691710:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970023.691731:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b48b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebb4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.691876:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b48b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.691891:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b48b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.691903:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b48b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970023.691934:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788970023.692062:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b48b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebb4 expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.692082:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b48b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebb4 expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.692090:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672a00) 00010000:00010000:0.0:1788970023.692093:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788970023.692096:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484600, rc 0) 00000100:00100000:0.0:1788970023.692156:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+44:11569:x1875870732080128:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 493us (694us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788970023.692164:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 201 00000100:00100000:3.0:1788970023.697231:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.697313:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732080256 00000100:00100000:0.0:1788970023.697325:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732080256 00000100:00100000:0.0:1788970023.697393:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:0.0:1788970023.697404:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+6:2353:x1875870732080256:12345-192.168.202.9@tcp:1:lfs.0 00010000:00010000:0.0:1788970023.697466:0:8534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.697493:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.697504:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970023.697508:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970023.697513:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.697569:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.697586:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 6 pid: 6676 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.697604:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778787cbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8534:1875870741503616:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970023.697723:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970023.699721:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778787cbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8534:1875870741503616:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970023.699761:0:8534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970023.701402:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.701493:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732080384 00000100:00100000:2.0:1788970023.701504:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732080384 00000100:00100000:2.0:1788970023.701575:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788970023.701587:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851af0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+44:2355:x1875870732080384:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970023.701605:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970023.701631:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ca00/0x5d0de860b05b48a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebad expref: 44 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.701653:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672a00) 00010000:00010000:2.0:1788970023.701660:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970023.701734:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851af0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+43:2355:x1875870732080384:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 149us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970023.701749:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788970023.704885:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.705133:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732080512 00000100:00100000:3.0:1788970023.705143:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732080512 00002000:00100000:3.0:1788970023.705207:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9778812e2940 x1875870732080512/t0(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:554/0 lens 504/0 e 0 to 0 dl 1788970034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970023.705220:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9778812e2940 with x1875870732080512 ext(0->8) 00010000:00010000:3.0:1788970023.705229:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 7 pid: 6676 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.705246:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 7 pid: 6676 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970023.705254:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9778812e2940 00000100:00100000:3.0:1788970023.705281:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:3.0:1788970023.705291:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732080512:12345-192.168.202.9@tcp:4:lfs.0 00000100:00100000:3.0:1788970023.705844:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2356:x1875870732080512:12345-192.168.202.9@tcp:4:lfs.0 Request processed in 552us (967us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788970023.705853:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00002000:00100000:3.0:1788970023.705861:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9778812e2940 x1875870732080512/t4294967308(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:554/0 lens 504/448 e 0 to 0 dl 1788970034 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970023.705869:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9778812e2940 with x1875870732080512 ext(0->8) 00010000:00010000:3.0:1788970023.705883:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 9 pid: 6676 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.705895:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 9 pid: 6676 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970023.705903:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9778812e2940 00000100:00100000:0.0:1788970023.709145:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.709248:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732080640 00000100:00100000:3.0:1788970023.709259:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732080640 00010000:00010000:3.0:1788970023.709301:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 9 pid: 6676 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970023.709346:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:3.0:1788970023.709357:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2355:x1875870732080640:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970023.709374:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788970023.709396:0:11142:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788970023.709399:0:11142:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788970023 00002000:00010000:3.0:1788970023.709401:0:11142:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788970024 00002000:00010000:3.0:1788970023.709403:0:11142:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788970023 00010000:00010000:3.0:1788970023.709409:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 9 pid: 6676 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.709424:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 9 pid: 6676 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.709449:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009194fffc/0x5d0de860b05b4887 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb9f expref: 9 pid: 6676 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.709489:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970023.709495:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970023.709501:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.709511:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.709636:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970023.709713:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2355:x1875870732080640:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 357us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970023.709721:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 75 00010000:00010000:0.0:1788970023.711485:0:8534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.711502:0:8534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.711641:0:8534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.711651:0:8534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.711899:0:8534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.711906:0:8534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970023.711911:0:8534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.711919:0:8534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.711937:0:8534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.711945:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b48c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.712100:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2353:x1875870732080256:12345-192.168.202.9@tcp:1:lfs.0 Request processed in 14692us (14874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970023.712111:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:2.0:1788970023.719345:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.719454:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732080896 00000100:00100000:1.0:1788970023.719468:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732080896 00000100:00100000:1.0:1788970023.719538:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:1.0:1788970023.719548:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+43:11569:x1875870732080896:12345-192.168.202.9@tcp:35:lfs.0 00000004:00010000:1.0:1788970023.719633:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b48b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebb4 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970023.719984:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788970023.720030:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788970023.720365:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788970023.720422:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.720439:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb91 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.720449:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.720488:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb91 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.720507:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb91 expref: 47 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.720522:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875870741503744:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970023.720684:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970023.724441:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.724530:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732081024 00000100:00100000:0.0:1788970023.724540:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732081024 00010000:00010000:0.0:1788970023.724586:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb91 expref: 48 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.724631:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:0.0:1788970023.724658:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+48:2354:x1875870732081024:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970023.724687:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970023.724695:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb91 expref: 48 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.724710:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb91 expref: 48 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.724983:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672a00) 00010000:00010000:0.0:1788970023.724990:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.725001:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.725008:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.725030:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970023.725088:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+48:2354:x1875870732081024:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 432us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970023.725096:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 76 00010000:00010000:1.0:1788970023.726252:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b4872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb91 expref: 47 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.726277:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875870741503744:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970023.726303:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.726335:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.726341:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970023.726470:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788970023.727005:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788970023.727148:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741503872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788970023.727217:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970023.727305:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4ed480 going to sleep for 11 seconds 00000100:00100000:3.0:1788970023.727345:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741503872 00000100:00100000:3.0:1788970023.727352:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741503872 00000100:00100000:3.0:1788970023.727476:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970023.727486:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875870741503872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788970023.727575:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875870741503872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970023.727581:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788970023.727702:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741503872:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788970023.728412:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788970023.728483:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741504000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788970023.728523:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970023.728550:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1788970023.728687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741504000 00000100:00100000:3.0:1788970023.728693:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741504000 00000100:00100000:3.0:1788970023.728733:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970023.728749:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875870741504000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788970023.728944:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875870741504000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 195us (419us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788970023.728962:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970023.729291:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778813a2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875870741504000:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788970023.729343:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788970023.729382:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.729393:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.729401:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.729407:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970023.729419:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.729428:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.729445:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672a00) 00010000:00010000:1.0:1788970023.729448:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788970023.729455:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.729462:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788970023.729649:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788970023.729916:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788970023.729929:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335693138935ns, next at 336693136197ns, rc = 0 00000001:00080000:1.0:1788970023.729936:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788970023.729975:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672a00) 00010000:00010000:1.0:1788970023.729978:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788970023.729985:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484600/0x5d0de860b05b48b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebb4 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.730153:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+50:11569:x1875870732080896:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 10605us (10821us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788970023.730163:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00000020:00080000:1.0:1788970023.730169:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1788970023.730283:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970023.733104:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.733215:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732081152 00000100:00100000:0.0:1788970023.733226:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732081152 00000100:00100000:0.0:1788970023.733320:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 202 00000100:00100000:0.0:1788970023.733333:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+50:11569:x1875870732081152:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970023.733361:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970023.733390:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b48d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.733477:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b48d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebbb expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.733493:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b48d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebbb expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.733514:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:0.0:1788970023.733517:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970023.733520:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485e00, rc 0) 00000100:00100000:0.0:1788970023.733625:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+51:11569:x1875870732081152:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 293us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970023.733633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 202 00000100:00100000:2.0:1788970023.736517:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.736638:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732081408 00000100:00100000:3.0:1788970023.736649:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732081408 00000100:00100000:3.0:1788970023.736716:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:3.0:1788970023.736726:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+51:11569:x1875870732081408:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1788970023.737358:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+52:11569:x1875870732081408:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 631us (849us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788970023.737368:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:2.0:1788970023.817700:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.817822:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732081536 00000100:00100000:1.0:1788970023.817833:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732081536 00000100:00100000:1.0:1788970023.817897:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 203 00000100:00100000:1.0:1788970023.817907:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+52:11580:x1875870732081536:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:1.0:1788970023.818009:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818029:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818041:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818059:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818067:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818073:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818205:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818214:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818221:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970023.818267:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818281:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818298:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818306:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818313:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970023.818317:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818325:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818339:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970023.818342:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970023.818348:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818355:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93a00/0x5d0de860b05b48db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818370:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818376:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818383:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818387:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970023.818396:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818403:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818411:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9778519ab600) 00010000:00010000:1.0:1788970023.818414:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970023.818417:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818423:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b48e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818438:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818444:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818450:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818454:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970023.818457:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818463:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818469:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970023.818471:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970023.818481:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.818487:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b48e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.818574:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+52:11580:x1875870732081536:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 666us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970023.818582:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 203 00000100:00100000:1.0:1788970023.857276:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.857397:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732081792 00000100:00100000:2.0:1788970023.857407:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732081792 00000100:00100000:2.0:1788970023.857473:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 204 00000100:00100000:2.0:1788970023.857484:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+52:11583:x1875870732081792:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970023.857506:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970023.857529:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b48f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebc2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.857606:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.857621:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.857632:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.857646:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.857653:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.857659:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858036:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858046:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858053:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970023.858063:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788970023.858166:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858184:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858192:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858198:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.858202:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858211:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858223:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970023.858226:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.858231:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858248:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b48f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858266:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858272:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858277:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858281:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970023.858284:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858289:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858297:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977851ac1c00) 00010000:00010000:2.0:1788970023.858299:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970023.858302:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858307:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b48fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858351:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b48f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc2 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858364:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc2 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.858377:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:2.0:1788970023.858379:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970023.858383:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d800, rc 0) 00000100:00100000:2.0:1788970023.858464:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:11583:x1875870732081792:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 981us (1201us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788970023.858473:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 204 00000100:00100000:2.0:1788970023.862205:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.862315:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732081920 00000100:00100000:1.0:1788970023.862327:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732081920 00000100:00100000:1.0:1788970023.862425:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 205 00000100:00100000:1.0:1788970023.862435:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:11583:x1875870732081920:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1788970023.862507:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.862525:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.862537:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.862564:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.862572:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.862579:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.862602:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970023.862607:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.862614:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.862627:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970023.862630:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970023.862635:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.862641:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93800/0x5d0de860b05b4913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.862775:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:11583:x1875870732081920:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 341us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970023.862782:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 205 00000100:00100000:2.0:1788970023.865512:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.865606:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732082176 00000100:00100000:0.0:1788970023.865615:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732082176 00000100:00100000:0.0:1788970023.865766:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:0.0:1788970023.865777:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+54:11583:x1875870732082176:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:0.0:1788970023.866048:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:11583:x1875870732082176:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 272us (547us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788970023.866056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:2.0:1788970023.940639:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970023.940816:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732082432 00000100:00100000:0.0:1788970023.940828:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732082432 00000100:00100000:0.0:1788970023.940942:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 206 00000100:00100000:0.0:1788970023.940953:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:11593:x1875870732082432:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970023.940979:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970023.940983:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788970023.941023:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eba6 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.941043:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:0.0:1788970023.941047:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970023.941059:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b491a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebc9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.941156:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.941179:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc2 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.941189:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.941220:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc2 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.941234:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc2 expref: 55 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.941246:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778787c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741504128:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970023.941345:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970023.951512:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.951563:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732082560 00000100:00100000:2.0:1788970023.951573:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732082560 00010000:00010000:2.0:1788970023.951615:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc2 expref: 56 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.951774:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778787c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875870741504128:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970023.951780:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:2.0:1788970023.951816:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+56:2353:x1875870732082560:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970023.951835:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970023.951844:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc2 expref: 56 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.951858:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc2 expref: 56 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.951882:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d800/0x5d0de860b05b4905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc2 expref: 56 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.951924:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:2.0:1788970023.951930:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.951938:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.951946:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.952014:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.952144:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970023.952217:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:2353:x1875870732082560:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 425us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970023.952224:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 77 00010000:00010000:0.0:1788970023.953499:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.953513:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970023.953533:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788970023.953875:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b491a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc9 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.953898:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc9 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.953905:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:0.0:1788970023.953908:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788970023.953910:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485000, rc 0) 00000100:00100000:0.0:1788970023.954013:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:11593:x1875870732082432:12345-192.168.202.9@tcp:101:bash.0 Request processed in 13062us (13388us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788970023.954023:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 206 00000100:00100000:3.0:1788970023.956369:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970023.956449:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732082816 00000100:00100000:1.0:1788970023.956461:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732082816 00000100:00100000:1.0:1788970023.956520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 207 00000100:00100000:1.0:1788970023.956531:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+55:11593:x1875870732082816:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:1.0:1788970023.956879:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.956897:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.956910:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970023.956987:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788970023.957013:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079a4ac4a reply state 00000000aedf03a5 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970023.957023:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970023.957394:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+58:11593:x1875870732082816:12345-192.168.202.9@tcp:36:bash.0 Request processed in 862us (1033us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788970023.957402:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 207 00000020:00080000:1.0:1788970023.957407:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788970023.963778:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.963878:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732082944 00000100:00100000:3.0:1788970023.963890:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732082944 00000100:00100000:3.0:1788970023.963951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 208 00000100:00100000:3.0:1788970023.963961:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+58:11593:x1875870732082944:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1788970023.963985:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970023.964008:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4936 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebd0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.964090:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.964106:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc9 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.964114:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.964141:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.964158:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.964194:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc9 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970023.964209:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc9 expref: 59 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970023.964224:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784c14fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741504256:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970023.964302:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c3000 going to sleep for 11 seconds 00010000:00010000:1.0:1788970023.964416:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.964426:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.964433:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.964439:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970023.964442:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.964448:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.964462:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970023.964466:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970023.964469:0:3269:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.964477:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970023.964491:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b492f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970023.968485:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970023.969132:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732083072 00000100:00100000:2.0:1788970023.969148:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732083072 00010000:00010000:2.0:1788970023.969207:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc9 expref: 59 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970023.969252:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:2.0:1788970023.969262:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:2354:x1875870732083072:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970023.969278:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970023.969286:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc9 expref: 59 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.969300:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc9 expref: 59 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.969349:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:2.0:1788970023.969354:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.969363:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.969371:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970023.969391:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970023.969504:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:2354:x1875870732083072:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 243us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970023.969513:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 78 00010000:00010000:3.0:1788970023.969975:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485000/0x5d0de860b05b4921 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebc9 expref: 58 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970023.969996:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784c14fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741504256:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970023.970021:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.971359:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.971372:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970023.971423:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788970023.971427:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970023.971469:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.971505:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4936 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd0 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.971525:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd0 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970023.971534:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:0.0:1788970023.971537:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970023.971541:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd200, rc 0) 00000100:00100000:0.0:1788970023.971708:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+57:11593:x1875870732082944:12345-192.168.202.9@tcp:101:bash.0 Request processed in 7748us (7941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970023.971716:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 208 00000100:00100000:0.0:1788970023.975092:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970023.975179:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732083328 00000100:00100000:3.0:1788970023.975189:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732083328 00000100:00100000:3.0:1788970023.975264:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:3.0:1788970023.975274:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+57:11593:x1875870732083328:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:3.0:1788970023.975486:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+58:11593:x1875870732083328:12345-192.168.202.9@tcp:35:bash.0 Request processed in 212us (403us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788970023.975509:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00010000:00010000:1.0:1788970024.005367:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970024.039329:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970024.039443:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732083456 00000100:00100000:2.0:1788970024.039457:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732083456 00000100:00100000:2.0:1788970024.039539:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 209 00000100:00100000:2.0:1788970024.039551:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+58:11599:x1875870732083456:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970024.039578:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970024.039604:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebd7 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.039698:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b494b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.039714:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b494b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.039727:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b494b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970024.039837:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788970024.039841:0:7061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970024.039861:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b494b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.039887:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd7 expref: 60 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.039908:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b494b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd7 expref: 59 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.039917:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970024.039920:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970024.039923:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c800, rc 0) 00000100:00100000:2.0:1788970024.039973:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:11599:x1875870732083456:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 424us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970024.039978:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 209 00000100:00100000:1.0:1788970024.046564:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970024.046666:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732083584 00000100:00100000:3.0:1788970024.046678:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732083584 00000100:00100000:3.0:1788970024.046746:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 210 00000100:00100000:3.0:1788970024.046766:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:11599:x1875870732083584:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970024.046826:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970024.046848:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4952 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebde expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.046916:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.046932:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.046945:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.046962:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.046969:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.046976:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047073:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047094:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047102:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970024.047141:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788970024.047146:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970024.047176:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047189:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047197:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047204:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047212:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047218:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970024.047223:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047230:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047243:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:3.0:1788970024.047246:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970024.047259:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047266:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd400/0x5d0de860b05b4959 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047284:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047291:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047297:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047302:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970024.047304:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047310:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047317:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff977858b3ce00) 00010000:00010000:3.0:1788970024.047319:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970024.047322:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047327:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dde00/0x5d0de860b05b4960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047360:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4952 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047388:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.047396:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:3.0:1788970024.047398:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970024.047401:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dc600, rc 0) 00000100:00100000:3.0:1788970024.047469:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11599:x1875870732083584:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 714us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970024.047476:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 210 00000100:00100000:0.0:1788970024.052340:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.052393:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.052502:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732083840 00000100:00100000:1.0:1788970024.052513:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732083840 00000100:00100000:1.0:1788970024.052581:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 211 00000100:00100000:1.0:1788970024.052593:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11599:x1875870732083840:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970024.052616:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970024.052640:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b496e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebe5 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.052768:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.052783:0:7061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd0 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.052829:0:7061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.052839:0:7061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.052879:0:7061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.052918:0:7061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 61 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.052933:0:7061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741504384:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970024.053040:0:7061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd0 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.053050:0:7061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd0 expref: 61 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.053059:0:7061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741504512:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970024.053085:0:7061:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970024.053382:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732083968 00000100:00100000:3.0:1788970024.053389:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732083968 00010000:00010000:3.0:1788970024.053415:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 62 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970024.053441:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:3.0:1788970024.053450:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+62:2356:x1875870732083968:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970024.053461:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970024.053467:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 62 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.053479:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 62 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.053498:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:3.0:1788970024.053503:0:11142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.053519:0:11142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.053524:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970024.053557:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+62:2356:x1875870732083968:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 109us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970024.053564:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:0.0:1788970024.057471:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970024.057543:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732084096 00000100:00100000:2.0:1788970024.057551:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732084096 00010000:00010000:2.0:1788970024.057589:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd0 expref: 62 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970024.057627:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:2.0:1788970024.057637:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787cb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+62:2353:x1875870732084096:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970024.057653:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970024.057659:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd0 expref: 62 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.057693:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd0 expref: 62 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.057714:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:2.0:1788970024.057720:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.057730:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.057744:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.057769:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970024.057838:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787cb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+62:2353:x1875870732084096:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 202us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970024.057845:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 80 00010000:00010000:1.0:1788970024.059102:0:7061:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.9@tcp) returned -22 from blocking AST (req@00000000310483ea x1875870741504384) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 61 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.059122:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc600/0x5d0de860b05b4967 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebde expref: 61 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.059142:0:7061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741504384:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970024.059156:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b493d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd0 expref: 60 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.059176:0:7061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741504512:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970024.059197:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970024.059220:0:7061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.059229:0:7061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.059234:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970024.059254:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788970024.059415:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b496e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebe5 expref: 61 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.059432:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebe5 expref: 60 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.059440:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970024.059443:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970024.059445:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92200, rc 0) 00000100:00100000:1.0:1788970024.059512:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11599:x1875870732083840:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 6922us (7118us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788970024.059520:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 211 00000100:00100000:3.0:1788970024.063520:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.063644:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732084352 00000100:00100000:0.0:1788970024.063656:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732084352 00000100:00100000:0.0:1788970024.063736:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:0.0:1788970024.063747:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11599:x1875870732084352:12345-192.168.202.9@tcp:103:lfs.0 00010000:00010000:0.0:1788970024.063779:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970024.063833:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b48d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebbb expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.063875:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:0.0:1788970024.063880:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970024.063941:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:11599:x1875870732084352:12345-192.168.202.9@tcp:103:lfs.0 Request processed in 196us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.063948:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:0.0:1788970024.066580:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970024.066657:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732084480 00000100:00100000:3.0:1788970024.066667:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732084480 00000100:00100000:3.0:1788970024.066747:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 212 00000100:00100000:3.0:1788970024.066768:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:11599:x1875870732084480:12345-192.168.202.9@tcp:58:lfs.0 00010000:00010000:3.0:1788970024.066916:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.066935:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.066948:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970024.067135:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788970024.067239:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:11599:x1875870732084480:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 481us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970024.067247:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 212 00000100:00100000:2.0:1788970024.073154:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.073325:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732084608 00000100:00100000:0.0:1788970024.073335:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732084608 00000100:00100000:0.0:1788970024.073399:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 213 00000100:00100000:0.0:1788970024.073408:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+59:11599:x1875870732084608:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970024.073429:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970024.073451:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b498a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.073511:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.073522:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b498a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebec expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.073539:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.073552:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b498a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebec expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.073565:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:0.0:1788970024.073581:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970024.073586:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b498a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebec expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.073594:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484a00, rc 0) 00000100:00100000:0.0:1788970024.073657:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11599:x1875870732084608:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 249us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.073663:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 213 00000100:00100000:3.0:1788970024.389756:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778789383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741504640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970024.389867:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970024.389949:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741504640 00000100:00100000:1.0:1788970024.389957:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741504640 00000100:00100000:1.0:1788970024.390015:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788970024.390024:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741504640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970024.390048:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970024.390109:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741504640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.390125:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788970024.390283:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778789383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741504640:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788970024.455001:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970024.455009:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970024.455068:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788970024.455075:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970024.455220:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784c14ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741504768:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788970024.455312:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970024.460138:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784c14ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741504768:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788970024.461448:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.462935:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732084736 00000100:00100000:0.0:1788970024.462948:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732084736 00000100:00100000:0.0:1788970024.463016:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 214 00000100:00100000:0.0:1788970024.463027:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11600:x1875870732084736:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788970024.463080:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788970024.463190:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11600:x1875870732084736:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 164us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.463198:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 214 00000100:00100000:0.0:1788970024.468036:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970024.468094:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732084864 00000100:00100000:2.0:1788970024.468528:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732084864 00000100:00100000:2.0:1788970024.470547:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 215 00000100:00100000:2.0:1788970024.470568:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11600:x1875870732084864:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788970024.470638:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470656:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470683:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470700:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470707:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470713:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470733:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470741:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470746:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970024.470780:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788970024.470784:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970024.470810:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470890:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470897:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470914:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470920:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44cc00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970024.470924:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470931:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470943:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:2.0:1788970024.470946:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970024.470951:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470957:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44cc00/0x5d0de860b05b4991 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470971:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470976:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470982:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.470987:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970024.470990:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471004:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471012:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff977851ac1f00) 00010000:00010000:2.0:1788970024.471015:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970024.471017:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471023:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4998 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471036:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471042:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471047:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471052:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44da00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970024.471055:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471061:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471067:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:2.0:1788970024.471069:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970024.471072:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.471086:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b499f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970024.471345:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11600:x1875870732084864:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 616us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970024.471927:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 215 00000100:00100000:3.0:1788970024.474152:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.474236:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732085120 00000100:00100000:0.0:1788970024.474247:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732085120 00000100:00100000:0.0:1788970024.474310:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 216 00000100:00100000:0.0:1788970024.474323:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+60:11600:x1875870732085120:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970024.474345:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970024.474384:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b49a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebf3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474484:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474523:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474536:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970024.474548:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788970024.474642:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474649:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474656:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474662:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970024.474666:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474673:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474684:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:0.0:1788970024.474687:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788970024.474691:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474698:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484e00/0x5d0de860b05b49ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474737:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b49a6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebf3 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474755:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:0.0:1788970024.474757:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970024.474761:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b49a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebf3 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.474770:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485600, rc 0) 00000100:00100000:0.0:1788970024.475100:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:11600:x1875870732085120:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 780us (956us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788970024.475118:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 216 00000001:00080000:0.0:1788970024.482009:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788970024.482026:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788970024.490332:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.490447:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732085248 00000100:00100000:1.0:1788970024.490458:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732085248 00000100:00100000:1.0:1788970024.490524:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 217 00000100:00100000:1.0:1788970024.490538:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:11600:x1875870732085248:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788970024.490576:0:7061:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788970024.490675:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:11600:x1875870732085248:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 141us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.490683:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 217 00000100:00100000:3.0:1788970024.505680:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.505904:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732085504 00000100:00100000:1.0:1788970024.505915:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732085504 00000100:00100000:1.0:1788970024.505984:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 218 00000100:00100000:1.0:1788970024.505995:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:11600:x1875870732085504:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970024.506017:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970024.506020:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788970024.506046:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c800/0x5d0de860b05b494b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebd7 expref: 61 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.506066:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970024.506071:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970024.506084:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b49bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ebfa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788970024.509206:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788970024.509479:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b49c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.509497:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b49c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.509510:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b49c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.509575:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92400/0x5d0de860b05b49bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebfa expref: 63 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.509598:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b49c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebfa expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.509629:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977849672400) 00010000:00010000:0.0:1788970024.509633:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970024.509636:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485600, rc 0) 00000100:00100000:0.0:1788970024.509736:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+62:11600:x1875870732085504:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 3742us (4065us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788970024.509745:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 218 00000100:00100000:1.0:1788970024.527014:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970024.527300:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732085760 00000100:00100000:2.0:1788970024.527311:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732085760 00000100:00100000:2.0:1788970024.527396:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 219 00000100:00100000:2.0:1788970024.527406:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+62:11600:x1875870732085760:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970024.527459:0:7061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970024.527483:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b49c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebfa expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527503:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977849672400) 00010000:00010000:2.0:1788970024.527514:0:7061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970024.527536:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527551:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527561:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527575:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527582:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527603:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527665:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527671:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527677:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527683:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44da00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970024.527688:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527696:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527704:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970024.527707:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970024.527711:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527718:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b49d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527728:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527734:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527747:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527753:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970024.527756:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527762:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527770:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x540924c4 (ffff977851ac1f00) 00010000:00010000:2.0:1788970024.527773:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970024.527776:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.527782:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x540924c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970024.528035:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:11600:x1875870732085760:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 629us (1029us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970024.528043:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 219 00000100:00100000:1.0:1788970024.531643:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970024.531722:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732085888 00000100:00100000:3.0:1788970024.531733:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732085888 00000100:00100000:3.0:1788970024.531816:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 220 00000100:00100000:3.0:1788970024.531983:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+61:11600:x1875870732085888:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970024.532005:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970024.532032:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b49de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec01 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.532072:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.532085:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.532098:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.532215:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b49de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec01 expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.532242:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec01 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.532251:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:3.0:1788970024.532254:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788970024.532257:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd200, rc 0) 00000100:00100000:3.0:1788970024.532318:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+62:11600:x1875870732085888:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 340us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970024.533498:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 220 00000100:00100000:0.0:1788970024.538591:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970024.538676:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732086144 00000100:00100000:2.0:1788970024.538687:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732086144 00000100:00100000:2.0:1788970024.538752:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 221 00000100:00100000:2.0:1788970024.538763:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+62:11600:x1875870732086144:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970024.538901:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.538919:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970024.538939:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970024.540233:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1788970024.540247:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336503456655ns, next at 337503454397ns, rc = 0 00000004:00010000:2.0:1788970024.540344:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016833a49 reply state 00000000f9857645 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970024.540522:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970024.540662:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+64:11600:x1875870732086144:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 1898us (2080us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788970024.540672:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 221 00010000:00010000:3.0:1788970024.545297:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.545319:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.545328:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.545335:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970024.545341:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.545351:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.545370:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:3.0:1788970024.545374:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788970024.545378:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.545407:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b49ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970024.545709:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.545856:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732086272 00000100:00100000:1.0:1788970024.545874:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732086272 00000100:00100000:1.0:1788970024.545979:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 222 00000100:00100000:1.0:1788970024.545991:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+63:11600:x1875870732086272:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970024.546016:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970024.546033:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec08 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.546094:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec08 expref: 64 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.546122:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec08 expref: 64 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.546142:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:1.0:1788970024.546146:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970024.546149:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93600, rc 0) 00000100:00100000:1.0:1788970024.546231:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+64:11600:x1875870732086272:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 242us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.546238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 222 00000100:00100000:1.0:1788970024.548461:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970024.548559:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732086400 00000100:00100000:2.0:1788970024.548568:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732086400 00000100:00100000:2.0:1788970024.548616:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:2.0:1788970024.548626:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2353:x1875870732086400:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788970024.548926:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:2353:x1875870732086400:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 300us (472us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788970024.548934:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:1.0:1788970024.553047:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.553211:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732086656 00000100:00100000:0.0:1788970024.553222:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732086656 00000100:00100000:0.0:1788970024.553342:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:0.0:1788970024.553353:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+64:11600:x1875870732086656:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788970024.553597:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+65:11600:x1875870732086656:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 245us (558us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788970024.553604:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:0.0:1788970024.560415:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.561292:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732086912 00000100:00100000:1.0:1788970024.561304:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732086912 00000100:00100000:1.0:1788970024.561367:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 223 00000100:00100000:1.0:1788970024.561374:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+65:11600:x1875870732086912:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788970024.561521:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+65:11600:x1875870732086912:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 148us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.561541:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 223 00000100:00100000:1.0:1788970024.575244:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.575330:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732087040 00000100:00100000:0.0:1788970024.575342:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732087040 00000100:00100000:0.0:1788970024.575400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 224 00000100:00100000:0.0:1788970024.575410:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+65:11600:x1875870732087040:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970024.575433:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970024.575454:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b49fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec0f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.575526:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4a01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.575550:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.575561:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970024.575598:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970024.575617:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.575641:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485800/0x5d0de860b05b49fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec0f expref: 67 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.575657:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4a01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec0f expref: 66 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.575665:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:0.0:1788970024.575669:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788970024.575672:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484800, rc 0) 00000100:00100000:0.0:1788970024.575735:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+66:11600:x1875870732087040:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 327us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.575743:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 224 00000100:00100000:3.0:1788970024.584943:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.586182:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732087168 00000100:00100000:1.0:1788970024.586196:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732087168 00000100:00100000:1.0:1788970024.586274:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:1.0:1788970024.586286:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+10:2353:x1875870732087168:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970024.586306:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970024.586330:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec16 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970024.586364:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa18428, blocks: 0x1 00010000:00010000:1.0:1788970024.586384:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1788970024.586389:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970024.586399:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec16 expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.586419:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec16 expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.586432:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93400, rc 0) 00000100:00100000:1.0:1788970024.586494:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:2353:x1875870732087168:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 210us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.586501:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:3.0:1788970024.597810:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970024.597936:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732087424 00000100:00100000:2.0:1788970024.597948:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732087424 00000100:00100000:2.0:1788970024.598012:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 225 00000100:00100000:2.0:1788970024.598022:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+66:11600:x1875870732087424:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788970024.598140:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+66:11600:x1875870732087424:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 119us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970024.598148:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 225 00000100:00100000:0.0:1788970024.607535:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.608311:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732087552 00000100:00100000:1.0:1788970024.608323:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732087552 00000100:00100000:1.0:1788970024.608413:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:1.0:1788970024.608424:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+11:11600:x1875870732087552:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970024.608442:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970024.608459:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec1d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.608486:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec16 expref: 12 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.608493:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970024.608497:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970024.608500:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.608529:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec16 expref: 12 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.608543:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec16 expref: 12 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.608557:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875870741504896:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970024.608649:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970024.613238:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875870741504896:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970024.613278:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.613321:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92e00, rc 0) 00000100:00100000:1.0:1788970024.613438:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:11600:x1875870732087552:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 5014us (5912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.613447:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:2.0:1788970024.627560:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.627713:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732087680 00000100:00100000:1.0:1788970024.627723:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732087680 00010000:00010000:1.0:1788970024.627764:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec16 expref: 12 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.627819:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:1.0:1788970024.627828:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:2353:x1875870732087680:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970024.627842:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970024.627866:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec16 expref: 12 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.627881:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec16 expref: 12 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.627903:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b4a08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec16 expref: 12 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.627922:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970024.627926:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970024.627935:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.627961:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.627998:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.628013:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875870741505024:192.168.202.9@tcp:105: 00000100:00100000:1.0:1788970024.628119:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970024.647356:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.647456:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732087808 00000100:00100000:0.0:1788970024.647465:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732087808 00002000:00100000:0.0:1788970024.647513:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff97787ff66d00 x1875870732087808/t0(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:555/0 lens 504/0 e 0 to 0 dl 1788970035 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970024.647525:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787ff66d00 with x1875870732087808 ext(0->12) 00002000:00010000:0.0:1788970024.647546:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787ff66d00 00000100:00100000:0.0:1788970024.647578:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788970024.647588:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:2353:x1875870732087808:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788970024.648061:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+14:2353:x1875870732087808:12345-192.168.202.9@tcp:4:lhsmtool_posix.0 Request processed in 472us (715us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788970024.648069:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00002000:00100000:0.0:1788970024.648076:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff97787ff66d00 x1875870732087808/t4294967320(0) o4->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:555/0 lens 504/448 e 0 to 0 dl 1788970035 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970024.648085:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787ff66d00 with x1875870732087808 ext(0->12) 00002000:00010000:0.0:1788970024.648088:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787ff66d00 00000100:00100000:1.0:1788970024.648246:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875870741505024:192.168.202.9@tcp:105: 00010000:00010000:1.0:1788970024.648270:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970024.648296:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2353:x1875870732087680:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 20469us (20747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.648305:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:2.0:1788970024.650899:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.651020:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732087936 00000100:00100000:0.0:1788970024.651030:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732087936 00000100:00100000:0.0:1788970024.651092:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 226 00000100:00100000:0.0:1788970024.651102:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+66:11600:x1875870732087936:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788970024.745656:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788970024.745702:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788970024.745717:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97787f4ed480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788970024.745722:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97787fa0cb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97787f4ed600 00000020:00080000:3.0:1788970024.745725:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97787fa0c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97787fbfd800 00000004:00080000:3.0:1788970024.745749:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788970024.745775:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788970024.745836:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9778813a9a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788970024.745840:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977878f95700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9778813a99c0 00000020:00080000:3.0:1788970024.745843:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977878f95d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9778512f5000 00000020:00080000:3.0:1788970024.745868:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788970024.746050:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788970024.746182:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741505152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788970024.746249:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970024.746311:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970024.746318:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741505280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788970024.746338:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970024.746369:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741505152 00000100:00100000:3.0:1788970024.746376:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741505152 00000100:00100000:3.0:1788970024.746440:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741505280 00000100:00100000:3.0:1788970024.746443:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741505280 00000100:00100000:3.0:1788970024.746465:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970024.746474:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741505152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788970024.746499:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788970024.746525:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.746548:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb7c expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.746556:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788970024.746561:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970024.746566:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.746592:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb7c expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.746607:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb7c expref: 12 pid: 6678 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970024.746618:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1875870741505408:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970024.746673:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1788970024.746690:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788970024.746698:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741505280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788970024.746857:0:8534:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788970024.746861:0:8534:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788970025 00002000:00010000:3.0:1788970024.746864:0:8534:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788970024.746866:0:8534:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788970024 -> 1788970025 00002000:00010000:3.0:1788970024.746868:0:8534:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788970024.746907:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3285:x1875870741505280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (567us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788970024.746914:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788970024.746939:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788970024.747076:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97787ff64780/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788970024.747083:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741505280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788970024.747474:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:11600:x1875870732087936:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 96371us (96583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.747484:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 226 00000100:00100000:0.0:1788970024.747593:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778787c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741505536:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788970024.747628:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970024.747682:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741505536 00000100:00100000:0.0:1788970024.747688:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741505536 00000100:00100000:0.0:1788970024.747715:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788970024.747722:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741505536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788970024.747738:0:8534:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1788970024.747773:0:8534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa18427, atime: 0x6aa18428, ctime: 0x6aa18427, blocks: 0xb 00010000:00010000:0.0:1788970024.747779:0:8534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.747822:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1788970024.747827:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970024.747833:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.747851:0:8534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.747863:0:8534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.747871:0:8534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.747891:0:8534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788970024.748461:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1875870741505536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 736us (830us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788970024.748469:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1788970024.748496:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970024.748504:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.748512:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970024.748525:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.748536:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.748556:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.748563:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4a1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.748582:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970024.748583:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970024.748585:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970024.748616:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788970024.748623:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1788970024.748649:0:3283:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9778787c92c0 x1875870741505536/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788970040 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788970024.748661:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9778787c92c0/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788970024.748666:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778787c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741505536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788970024.752906:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.752996:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732088064 00000100:00100000:0.0:1788970024.753006:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732088064 00010000:00010000:0.0:1788970024.753044:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb7c expref: 13 pid: 6678 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970024.753081:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:0.0:1788970024.753107:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2353:x1875870732088064:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970024.753125:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970024.753131:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb7c expref: 13 pid: 6678 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.753146:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb7c expref: 13 pid: 6678 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.753202:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970024.753207:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970024.753213:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.753223:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.753242:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970024.753295:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+13:2353:x1875870732088064:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 190us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.753303:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 82 00010000:00010000:1.0:1788970024.753430:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f62fd93/0x5d0de860b05b47d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb7c expref: 12 pid: 6678 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.753449:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1875870741505408:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970024.753473:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.753483:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.753505:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.753516:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.753524:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.753549:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788970024.754127:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3285:x1875870741505152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7652us (7876us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788970024.754136:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1788970024.754224:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970024.754231:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.754241:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970024.754245:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.754262:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.754278:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.754285:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b4a16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.754307:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970024.754309:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970024.754311:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788970024.754519:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97787ff65e00/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788970024.754526:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741505152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788970024.761013:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.763289:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732088192 00000100:00100000:1.0:1788970024.763307:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732088192 00000100:00100000:1.0:1788970024.763382:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:1.0:1788970024.763393:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+12:2354:x1875870732088192:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788970024.809523:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1788970024.809543:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1788970024.809712:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732088192:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 46314us (48701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.809724:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:2.0:1788970024.818455:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.818769:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732088448 00000100:00100000:0.0:1788970024.818779:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732088448 00000100:00100000:0.0:1788970024.818874:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 227 00000100:00100000:0.0:1788970024.818884:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:11600:x1875870732088448:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788970024.818938:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970024.818964:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484800/0x5d0de860b05b4a01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec0f expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.818985:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:0.0:1788970024.818991:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970024.819019:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.819032:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.819058:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970024.819297:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb5ab61b reply state 000000004831db2d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970024.819306:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970024.819405:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:11600:x1875870732088448:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 522us (957us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788970024.819412:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 227 00010000:00010000:1.0:1788970024.824387:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.824404:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.824437:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.824443:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970024.824448:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.824456:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.824473:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:1.0:1788970024.824477:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970024.824482:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.824488:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485c00/0x5d0de860b05b4a24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970024.825143:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.825228:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732088576 00000100:00100000:0.0:1788970024.825238:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732088576 00000100:00100000:0.0:1788970024.825293:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:0.0:1788970024.825304:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732088576:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788970024.825552:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788970024.825556:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788970025 -> 1788970024 00002000:00010000:0.0:1788970024.825559:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788970024 00002000:00010000:0.0:1788970024.825561:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788970025 -> 1788970024 00002000:00010000:0.0:1788970024.825563:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788970024.825627:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2354:x1875870732088576:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 325us (488us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788970024.825635:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:0.0:1788970024.834145:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970024.834347:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732088832 00000100:00100000:3.0:1788970024.834360:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732088832 00000100:00100000:3.0:1788970024.834422:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 228 00000100:00100000:3.0:1788970024.834431:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:11600:x1875870732088832:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788970024.834501:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.834520:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec01 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.834550:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.834584:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec01 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.834597:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec01 expref: 20 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970024.834611:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff67840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741505664:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970024.834708:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970024.842740:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.842835:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732088960 00000100:00100000:0.0:1788970024.842845:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732088960 00010000:00010000:0.0:1788970024.842888:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec01 expref: 21 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970024.842956:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:0.0:1788970024.842966:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:2354:x1875870732088960:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970024.842982:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970024.842989:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec01 expref: 21 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.843004:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec01 expref: 21 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.843025:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:0.0:1788970024.843029:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.843038:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.843046:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.843066:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970024.843123:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:2354:x1875870732088960:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 159us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.843130:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 83 00010000:00010000:1.0:1788970024.843277:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd200/0x5d0de860b05b49e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec01 expref: 20 pid: 5834 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.843295:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff67840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875870741505664:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970024.843316:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.843325:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.843330:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.843416:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.843424:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.843430:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.843437:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970024.843442:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.843449:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.843459:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:1.0:1788970024.843462:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788970024.843466:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.843472:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dc000/0x5d0de860b05b4a2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.843514:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11600:x1875870732088832:12345-192.168.202.9@tcp:55:lhsmtool_posix.0 Request processed in 9084us (9379us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788970024.843523:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 228 00000100:00100000:3.0:1788970024.845997:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.846106:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732089088 00000100:00100000:0.0:1788970024.846116:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732089088 00000100:00100000:0.0:1788970024.846178:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:0.0:1788970024.846189:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2354:x1875870732089088:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788970024.846254:0:8534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.846276:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.846284:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970024.846288:0:8534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970024.846293:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.846326:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.846340:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 8 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970024.846354:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778787cad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8534:1875870741505792:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970024.846435:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970024.848083:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778787cad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8534:1875870741505792:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970024.848110:0:8534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970024.849244:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.852018:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732089216 00000100:00100000:0.0:1788970024.852035:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732089216 00010000:00010000:0.0:1788970024.852086:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 9 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970024.852237:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:0.0:1788970024.852248:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+9:2354:x1875870732089216:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970024.852264:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970024.852287:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 9 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.852300:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 9 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.852323:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4a0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec1d expref: 9 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.852338:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970024.852342:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970024.852347:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.852356:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.852396:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970024.852459:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2354:x1875870732089216:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 212us (3221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.852466:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 84 00010000:00010000:1.0:1788970024.853477:0:8534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.853509:0:8534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.853545:0:8534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.853555:0:8534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.853563:0:8534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.853572:0:8534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970024.853577:0:8534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.853587:0:8534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.853605:0:8534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.853613:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4a32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.853720:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2354:x1875870732089088:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 7530us (7729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.853729:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:3.0:1788970024.856399:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.856749:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732089472 00000100:00100000:0.0:1788970024.856758:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732089472 00000100:00100000:0.0:1788970024.856934:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 229 00000100:00100000:0.0:1788970024.856945:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11600:x1875870732089472:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788970024.857022:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.857040:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.857050:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.857270:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.857282:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec08 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.857290:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.857322:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec08 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.857337:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec08 expref: 20 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970024.857351:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778787cad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741505920:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970024.857492:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970024.875614:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.875810:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778787cad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741505920:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970024.875840:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.876032:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732089600 00000100:00100000:1.0:1788970024.876041:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732089600 00010000:00010000:1.0:1788970024.876080:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec08 expref: 21 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.876118:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:1.0:1788970024.876127:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:2354:x1875870732089600:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970024.876141:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970024.876148:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec08 expref: 21 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.876172:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec08 expref: 21 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.876194:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b49f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec08 expref: 21 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.876210:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:1.0:1788970024.876215:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.876225:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.876253:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.876325:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970024.876385:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:2354:x1875870732089600:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 258us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970024.876393:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 85 00010000:00010000:0.0:1788970024.881298:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.881317:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970024.881932:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788970024.882061:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788970024.882104:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788970024.882201:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875870741506048:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788970024.882298:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970024.882591:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970024.882648:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741506048 00000100:00100000:3.0:1788970024.882657:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741506048 00000100:00100000:3.0:1788970024.882844:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970024.882854:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1875870741506048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788970024.882947:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1875870741506048:12345-0@lo:1000:mdt00_000.0 Request processed in 95us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970024.882955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970024.883033:0:5832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1788970024.883039:0:5832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1788970024.883059:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97787ff64780, transno 4294967321 00000004:00080000:1.0:1788970024.883080:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97787ff65e00, transno 4294967322 00000100:00100000:1.0:1788970024.883086:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875870741506048:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788970024.883523:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788970024.883586:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875870741506176:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788970024.883618:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970024.885872:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970024.885933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741506176 00000100:00100000:0.0:1788970024.885942:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741506176 00000100:00100000:0.0:1788970024.885991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788970024.886000:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1875870741506176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788970024.886283:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1875870741506176:12345-0@lo:1000:mdt00_000.0 Request processed in 284us (2662us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788970024.886291:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788970024.886359:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875870741506176:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788970024.886396:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886407:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886428:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886435:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970024.886439:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886447:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886462:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff977858b3c800) 00010000:00010000:1.0:1788970024.886465:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970024.886470:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886598:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485600/0x5d0de860b05b4a40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886629:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886636:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886642:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886758:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970024.886762:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886779:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886866:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970024.886869:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970024.886876:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b498a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebec expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886888:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b498a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebec expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886898:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b498a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebec expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.886930:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b498a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebec expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.886945:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741506304:192.168.202.9@tcp:105: 00000100:00100000:1.0:1788970024.887019:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970024.889914:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.890036:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732089728 00000100:00100000:0.0:1788970024.890045:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732089728 00000100:00100000:0.0:1788970024.890098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:0.0:1788970024.890109:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11599:x1875870732089728:12345-192.168.202.9@tcp:49:lfs.0 00000100:00100000:0.0:1788970024.890264:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+24:11599:x1875870732089728:12345-192.168.202.9@tcp:49:lfs.0 Request processed in 157us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.890271:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:1.0:1788970024.890318:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875870741506304:192.168.202.9@tcp:105: 00010000:00010000:1.0:1788970024.890347:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890357:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4983 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890391:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890420:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890433:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890443:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890449:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890456:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890462:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970024.890466:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890473:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890484:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970024.890487:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970024.890491:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890496:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890505:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890517:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890524:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890529:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970024.890531:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890537:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890546:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970024.890548:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788970024.890551:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.890557:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485a00/0x5d0de860b05b4a39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.891225:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:11600:x1875870732089472:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 34277us (34833us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788970024.891235:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 229 00000020:00080000:1.0:1788970024.891239:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788970024.891881:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970024.891887:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970024.892414:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788970024.892435:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970024.895250:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.895362:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732089984 00000100:00100000:0.0:1788970024.895372:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732089984 00000100:00100000:0.0:1788970024.895430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:0.0:1788970024.895441:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+23:11600:x1875870732089984:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788970024.900497:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788970024.900615:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788970024.901203:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970024.901462:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732090240 00000100:00100000:0.0:1788970024.901473:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732090240 00000100:00100000:0.0:1788970024.901535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 230 00000100:00100000:0.0:1788970024.901546:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11599:x1875870732090240:12345-192.168.202.9@tcp:58:lfs.0 00000040:00080000:0.0:1788970024.901830:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788970024.902152:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878949a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11599:x1875870732090240:12345-192.168.202.9@tcp:58:lfs.0 Request processed in 606us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.902170:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 230 00010000:00010000:1.0:1788970024.903841:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.903880:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.903893:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.903902:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.903981:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.903989:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.904005:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970024.904199:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970024.904206:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.904213:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970024.904217:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.904226:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.904238:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9778519ab600) 00010000:00010000:0.0:1788970024.904241:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788970024.904246:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.904251:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b4a4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970024.904272:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970024.904274:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970024.904284:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970024.904327:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:11600:x1875870732089984:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 8884us (9082us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788970024.904337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00000020:00080000:1.0:1788970024.904344:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788970024.937548:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970024.937884:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732090368 00000100:00100000:1.0:1788970024.937896:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732090368 00000100:00100000:1.0:1788970024.938040:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 231 00000100:00100000:1.0:1788970024.938051:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+25:11602:x1875870732090368:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970024.938077:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970024.938100:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec24 expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938179:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938203:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938214:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938229:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938236:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938243:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938479:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938491:0:7061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebe5 expref: 26 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938500:0:7061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938533:0:7061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebe5 expref: 26 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.938547:0:7061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebe5 expref: 26 pid: 7061 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970024.938574:0:7061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741506432:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970024.944285:0:7061:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c2740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970024.947414:0:7061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7061:1875870741506432:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970024.947450:0:7061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970024.947768:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970024.948243:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732090624 00000100:00100000:3.0:1788970024.948252:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732090624 00000100:00100000:3.0:1788970024.948315:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:3.0:1788970024.948326:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:5595:x1875870732090624:12345-192.168.202.9@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788970024.948586:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:5595:x1875870732090624:12345-192.168.202.9@tcp:35:ldlm_bl.0 Request processed in 261us (819us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788970024.948594:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:0.0:1788970024.951863:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970024.952077:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732090752 00000100:00100000:3.0:1788970024.952087:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732090752 00010000:00010000:3.0:1788970024.952127:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebe5 expref: 28 pid: 7061 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970024.952202:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:3.0:1788970024.952212:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787cad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:2354:x1875870732090752:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970024.952226:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970024.952233:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebe5 expref: 28 pid: 7061 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.952248:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebe5 expref: 28 pid: 7061 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.952272:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4975 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebe5 expref: 28 pid: 7061 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.952289:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:3.0:1788970024.952310:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.952321:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.952329:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970024.952405:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970024.952482:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787cad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+27:2354:x1875870732090752:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 271us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970024.952489:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 86 00010000:00010000:1.0:1788970024.961021:0:7061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961043:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970024.961097:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788970024.961102:0:7061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970024.961127:0:7061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961146:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961295:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961303:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961310:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961316:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970024.961341:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961348:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961364:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970024.961367:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970024.961372:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961378:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4a5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961396:0:7061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961402:0:7061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961407:0:7061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961412:0:7061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970024.961415:0:7061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961420:0:7061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961426:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9778519ab900) 00010000:00010000:1.0:1788970024.961429:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970024.961440:0:7061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961446:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961492:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b4a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec24 expref: 27 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961506:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec24 expref: 26 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970024.961513:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970024.961515:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970024.961518:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93e00, rc 0) 00000100:00100000:0.0:1788970024.967501:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11602:x1875870732090368:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 29438us (29951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970024.967515:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 231 00000100:00100000:3.0:1788970025.024548:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970025.024655:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970025.024702:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970025.024745:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732091136 00000100:00100000:0.0:1788970025.024757:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732091136 00000100:00100000:0.0:1788970025.024856:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 146 00000100:00080000:3.0:1788970025.024860:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970025.024867:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732091136:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970025.024974:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2354:x1875870732091136:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970025.024982:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 146 00000100:00100000:2.0:1788970025.025061:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732091008 00000100:00100000:2.0:1788970025.025066:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732091008 00000100:00100000:2.0:1788970025.025114:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00100000:2.0:1788970025.025122:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732091008:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970025.025152:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2354:x1875870732091008:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 32us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970025.025167:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 70 00000100:00080000:0.0:1788970025.025242:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788970025.029075:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970025.033899:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732090880 00000100:00100000:1.0:1788970025.034119:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732090880 00000100:00100000:0.0:1788970025.038578:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 292 00000100:00100000:0.0:1788970025.038593:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732090880:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970025.038697:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2354:x1875870732090880:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 106us (14158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970025.038704:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 292 00000100:00100000:3.0:1788970025.416151:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741506688:0@lo:400:kworker.0 00000100:00100000:3.0:1788970025.416235:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970025.416281:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787933f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741507200:0@lo:400:kworker.0 00000100:00100000:3.0:1788970025.416307:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970025.416336:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788970025.416342:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787933f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741506816:0@lo:400:kworker.0 00000100:00100000:3.0:1788970025.416361:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970025.416375:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787933e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741507328:0@lo:400:kworker.0 00000100:00100000:3.0:1788970025.416395:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970025.420413:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741507328 00000100:00100000:1.0:1788970025.420432:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741507328 00000100:00100000:1.0:1788970025.420511:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788970025.420522:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875870741507328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970025.420622:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875870741507328:12345-0@lo:400:kworker.0 Request processed in 102us (4225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970025.420629:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788970025.420692:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787933e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741507328:0@lo:400:kworker.0 00000100:00100000:1.0:1788970025.421014:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787933e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741506944:0@lo:400:kworker.0 00000100:00100000:1.0:1788970025.421056:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970025.421092:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788970025.421099:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741506560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970025.421143:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970025.421172:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787933f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741507072:0@lo:400:kworker.0 00000100:00100000:1.0:1788970025.421195:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970025.421491:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741507200 00000100:00100000:2.0:1788970025.421497:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741507200 00000100:00100000:2.0:1788970025.421577:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741506816 00000100:00100000:2.0:1788970025.421580:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741506816 00000100:00100000:2.0:1788970025.421592:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741506944 00000100:00100000:2.0:1788970025.421594:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741506944 00000100:00100000:2.0:1788970025.421605:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788970025.421612:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741507200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970025.421653:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741507200:12345-0@lo:400:kworker.0 Request processed in 42us (5345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970025.421660:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788970025.421674:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788970025.421680:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741506816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970025.421705:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741506816:12345-0@lo:400:kworker.0 Request processed in 25us (5343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970025.421718:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788970025.421729:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788970025.421735:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741506944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970025.421764:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741506944:12345-0@lo:400:kworker.0 Request processed in 29us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970025.421770:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788970025.421786:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741507072 00000100:00100000:2.0:1788970025.421810:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741507072 00000100:00100000:2.0:1788970025.421835:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788970025.421842:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1875870741507072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970025.421868:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1875870741507072:12345-0@lo:400:kworker.0 Request processed in 27us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970025.421874:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788970025.422395:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741506688 00000100:00100000:0.0:1788970025.422400:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741506688 00000100:00100000:0.0:1788970025.422430:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788970025.422437:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741506688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970025.422474:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741506688:12345-0@lo:400:kworker.0 Request processed in 38us (6240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970025.422480:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1788970025.422593:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970025.422598:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970025.422630:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787933f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741507072:0@lo:400:kworker.0 00000100:00100000:1.0:1788970025.422642:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787933e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741506944:0@lo:400:kworker.0 00000100:00100000:1.0:1788970025.422672:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787933f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741506816:0@lo:400:kworker.0 00000100:00100000:1.0:1788970025.422680:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741506688:0@lo:400:kworker.0 00000100:00100000:1.0:1788970025.422690:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787933f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741507200:0@lo:400:kworker.0 00000100:00100000:3.0:1788970025.424145:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741506560 00000100:00100000:3.0:1788970025.424168:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741506560 00000100:00100000:3.0:1788970025.424236:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970025.424244:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875870741506560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970025.424267:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788970025.424328:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875870741506560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (3183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970025.424334:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788970025.426387:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741506560:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788970025.690494:0:12533:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970025.690502:0:12533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970025.690542:0:12533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788970025.690547:0:12533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788970025.925059:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970025.925068:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970025.925106:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788970025.925113:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970025.925609:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787933cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741507456:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788970025.925723:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970025.935443:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970025.935444:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787933cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875870741507456:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788970025.935686:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732091264 00000100:00100000:0.0:1788970025.935694:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732091264 00000100:00100000:0.0:1788970025.935761:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 232 00000100:00100000:0.0:1788970025.935771:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11615:x1875870732091264:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788970025.935839:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788970025.935933:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11615:x1875870732091264:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 163us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970025.935941:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 232 00000100:00080000:1.0:1788970025.936266:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970025.947228:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970025.947891:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732091520 00000100:00100000:2.0:1788970025.947911:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732091520 00000100:00100000:2.0:1788970025.947975:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 233 00000100:00100000:2.0:1788970025.947986:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+26:11615:x1875870732091520:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970025.948006:0:7061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970025.948027:0:7061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b4a71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec2b expref: -99 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970025.948264:0:7061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4a78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970025.948278:0:7061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970025.948302:0:7061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970025.948315:0:7061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788970025.949002:0:7061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d200/0x5d0de860b05b4a71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec2b expref: 29 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970025.949024:0:7061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec2b expref: 28 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970025.949030:0:7061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:2.0:1788970025.949093:0:7061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970025.949097:0:7061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c600, rc 0) 00000100:00100000:2.0:1788970025.949193:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:11615:x1875870732091520:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1208us (1973us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788970025.949201:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 233 00000100:00100000:3.0:1788970025.963510:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970025.963560:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970025.963599:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732091776 00000100:00100000:0.0:1788970025.963609:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732091776 00000100:00100000:0.0:1788970025.963674:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 234 00000100:00100000:0.0:1788970025.963684:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:11615:x1875870732091776:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788970025.963763:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970025.963781:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970025.963840:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970025.963972:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732091904 00000100:00100000:1.0:1788970025.963977:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732091904 00000100:00100000:1.0:1788970025.964017:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:1.0:1788970025.964026:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851af2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+30:2355:x1875870732091904:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970025.964030:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970025.964037:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970025.964275:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970025.964284:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970025.965305:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4a78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec2b expref: 30 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970025.965327:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970025.965332:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970025.965410:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851af2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:2355:x1875870732091904:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1385us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970025.965432:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00010000:00010000:0.0:1788970025.966834:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970025.966847:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970025.966861:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970025.966876:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:0.0:1788970025.966879:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788970025.966884:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970025.966891:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485e00/0x5d0de860b05b4a86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970025.967994:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:11615:x1875870732091776:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 4303us (4485us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788970025.968006:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 234 00000040:00080000:2.0:1788970025.968066:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970025.968071:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970025.968566:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788970025.968574:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970025.971779:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970025.971870:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732092160 00000100:00100000:0.0:1788970025.971880:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732092160 00000100:00100000:0.0:1788970025.971945:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:0.0:1788970025.971965:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+28:11615:x1875870732092160:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788970025.972221:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:11615:x1875870732092160:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 267us (450us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788970025.972229:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00010000:00010000:0.0:1788970026.053027:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970027.078407:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788970027.573643:0:12584:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970027.573653:0:12584:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970027.573700:0:12584:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788970027.573705:0:12584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970027.735824:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970027.735913:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732092416 00000100:00100000:0.0:1788970027.735933:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732092416 00000100:00100000:0.0:1788970027.735993:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 235 00000100:00100000:0.0:1788970027.736001:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+29:11635:x1875870732092416:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970027.736023:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970027.736041:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4a8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec32 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970027.736121:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4a94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970027.736144:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970027.736155:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970027.736168:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788970027.736318:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f485200/0x5d0de860b05b4a8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec32 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970027.736334:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec32 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970027.736342:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:0.0:1788970027.736345:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788970027.736348:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484400, rc 0) 00000100:00100000:0.0:1788970027.736402:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:11635:x1875870732092416:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 402us (617us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788970027.736409:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 235 00000100:00080000:2.0:1788970027.736704:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970027.739045:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970027.739122:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732092544 00000100:00100000:2.0:1788970027.739131:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732092544 00000100:00100000:2.0:1788970027.739200:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 236 00000100:00100000:2.0:1788970027.739211:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:11635:x1875870732092544:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:2.0:1788970027.739280:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970027.739311:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970027.739323:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970027.739352:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970027.739359:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970027.739366:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970027.739371:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44da00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970027.739375:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970027.739380:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970027.739390:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:2.0:1788970027.739392:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970027.739395:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970027.739400:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44da00/0x5d0de860b05b4aa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970027.739669:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+31:11635:x1875870732092544:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 458us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970027.739683:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 236 00000100:00100000:3.0:1788970027.804600:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970027.805180:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732092672 00000100:00100000:1.0:1788970027.805191:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732092672 00000100:00100000:1.0:1788970027.805345:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00100000:1.0:1788970027.805356:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732092672:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:1.0:1788970027.805377:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970027.805402:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4aa9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec39 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970027.805433:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa18428, atime: 0x6aa18428, ctime: 0x6aa18428, blocks: 0xb 00010000:00010000:1.0:1788970027.805454:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1788970027.805459:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970027.805468:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec39 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970027.805485:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec39 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970027.805496:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93a00, rc 0) 00000100:00100000:1.0:1788970027.805568:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2356:x1875870732092672:12345-192.168.202.9@tcp:101:cat.0 Request processed in 213us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970027.805574:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 71 00000100:00080000:2.0:1788970027.806146:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970027.811165:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970027.812116:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732092800 00000100:00100000:0.0:1788970027.812128:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732092800 00002000:00100000:0.0:1788970027.812193:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff97787933c000 x1875870732092800/t0(0) o3->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:558/0 lens 488/0 e 0 to 0 dl 1788970038 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970027.812203:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787933c000 with x1875870732092800 ext(0->4095) 00002000:00010000:0.0:1788970027.812209:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787933c000 00000100:00100000:0.0:1788970027.812288:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970027.812299:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2356:x1875870732092800:12345-192.168.202.9@tcp:3:cat.0 00000100:00100000:0.0:1788970027.812515:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+8:2356:x1875870732092800:12345-192.168.202.9@tcp:3:cat.0 Request processed in 217us (1361us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788970027.812523:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00002000:00100000:0.0:1788970027.812530:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff97787933c000 x1875870732092800/t0(0) o3->c7778032-abf5-4f7d-b43e-a87bfd7b090c@192.168.202.9@tcp:558/0 lens 488/4536 e 0 to 0 dl 1788970038 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970027.812538:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787933c000 with x1875870732092800 ext(0->4095) 00002000:00010000:0.0:1788970027.812541:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787933c000 00010000:00010000:0.0:1788970028.101088:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970029.125015:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970029.521580:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778787cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741507584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970029.521671:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970029.521760:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741507584 00000100:00100000:0.0:1788970029.521769:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741507584 00000100:00100000:0.0:1788970029.521854:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788970029.521866:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875870741507584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970029.521897:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970029.521941:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875870741507584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970029.521958:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788970029.521977:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970029.522016:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778787cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741507584:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788970029.556417:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788970030.084931:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788970030.084964:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97784c274a80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788970030.084969:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97787fa0c000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97784c274c00 00000020:00080000:3.0:1788970030.084973:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97787fa0ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97787fbfdc00 00000020:00080000:3.0:1788970030.084996:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788970030.085006:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788970030.085177:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1788970030.099859:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1788970030.099876:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:3.0:1788970030.139395:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970030.139445:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970030.139477:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970030.139500:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970030.139521:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970030.139592:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732093440 00000100:00100000:3.0:1788970030.139601:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732093440 00000100:00100000:3.0:1788970030.139659:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732093056 00000100:00100000:3.0:1788970030.139662:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732093056 00000100:00100000:3.0:1788970030.139681:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 150 00000100:00100000:3.0:1788970030.139690:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732093440:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970030.139754:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732093440:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 66us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970030.139762:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 150 00000100:00100000:3.0:1788970030.139776:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 151 00000100:00100000:3.0:1788970030.139782:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:2356:x1875870732093056:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970030.139827:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:2356:x1875870732093056:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 44us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970030.139845:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 151 00000100:00100000:3.0:1788970030.139868:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732093184 00000100:00100000:3.0:1788970030.139871:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732093184 00000100:00100000:3.0:1788970030.139895:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732093312 00000100:00100000:3.0:1788970030.139897:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732093312 00000100:00100000:3.0:1788970030.139913:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:3.0:1788970030.139932:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2356:x1875870732093184:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970030.139956:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2356:x1875870732093184:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970030.139962:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:3.0:1788970030.139971:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:3.0:1788970030.139976:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732093312:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970030.139992:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732093312:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 16us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970030.139997:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00080000:3.0:1788970030.140010:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970030.140013:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970030.140016:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970030.140331:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732092928 00000100:00100000:1.0:1788970030.140343:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732092928 00000100:00100000:1.0:1788970030.140380:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 294 00000100:00100000:1.0:1788970030.140387:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732092928:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970030.140419:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732092928:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 33us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970030.140425:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 294 00010000:00010000:0.0:1788970030.149955:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970030.533211:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787933f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741507712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970030.533280:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970030.535172:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741507840:0@lo:400:kworker.0 00000100:00100000:2.0:1788970030.535249:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741507968:0@lo:400:kworker.0 00000100:00100000:3.0:1788970030.535250:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970030.535284:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970030.535287:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741508352:0@lo:400:kworker.0 00000100:00100000:3.0:1788970030.535310:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970030.535331:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741507840 00000100:00100000:3.0:1788970030.535336:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741507968 00000100:00100000:3.0:1788970030.535341:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741507968 00000100:00100000:2.0:1788970030.535341:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741507840 00000100:00100000:3.0:1788970030.535377:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741508352 00000100:00100000:2.0:1788970030.535381:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788970030.535391:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741507840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970030.535395:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741508352 00000100:00100000:3.0:1788970030.535425:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788970030.535431:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741507968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970030.535439:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741507840:12345-0@lo:400:kworker.0 Request processed in 50us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970030.535446:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788970030.535464:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741507968:12345-0@lo:400:kworker.0 Request processed in 34us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970030.535470:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788970030.535483:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788970030.535488:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741508352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970030.535491:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741508096:0@lo:400:kworker.0 00000100:00100000:2.0:1788970030.535511:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970030.535512:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741508352:12345-0@lo:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970030.535519:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788970030.535524:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970030.535527:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741508096 00000100:00100000:2.0:1788970030.535529:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741508224:0@lo:400:kworker.0 00000100:00100000:3.0:1788970030.535530:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741508096 00000100:00100000:3.0:1788970030.535545:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788970030.535551:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741508096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970030.535551:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970030.535581:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741508096:12345-0@lo:400:kworker.0 Request processed in 30us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970030.535587:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788970030.535591:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970030.535603:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741508224 00000100:00100000:3.0:1788970030.535606:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741508224 00000100:00100000:2.0:1788970030.535633:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741507968:0@lo:400:kworker.0 00000100:00100000:3.0:1788970030.535649:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788970030.535655:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741508224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970030.535657:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741507840:0@lo:400:kworker.0 00000100:00100000:2.0:1788970030.535665:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741508352:0@lo:400:kworker.0 00000100:00100000:3.0:1788970030.535684:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741508224:12345-0@lo:400:kworker.0 Request processed in 29us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970030.535690:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788970030.535690:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788970030.535695:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9778787c92c0, transno 4294967310 00000100:00100000:2.0:1788970030.535847:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741508224:0@lo:400:kworker.0 00000100:00100000:2.0:1788970030.535863:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741508096:0@lo:400:kworker.0 00000100:00100000:1.0:1788970030.539520:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741507712 00000100:00100000:1.0:1788970030.539535:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741507712 00000100:00080000:2.0:1788970030.539624:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970030.539775:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788970030.539805:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741507712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970030.539853:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970030.540290:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741507712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 504us (7008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970030.540299:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788970030.540395:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788970030.540401:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788970030.540431:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787933f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741507712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788970031.172916:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970031.726261:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970031.726701:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732093568 00000100:00100000:2.0:1788970031.726710:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732093568 00000100:00100000:2.0:1788970031.726761:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 237 00000100:00100000:2.0:1788970031.726771:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:11279:x1875870732093568:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788970031.727073:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:11279:x1875870732093568:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 Request processed in 301us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970031.727081:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 237 00000100:00100000:3.0:1788970031.728936:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970031.729253:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732093824 00000100:00100000:2.0:1788970031.729263:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732093824 00000100:00100000:2.0:1788970031.729374:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:2.0:1788970031.729385:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787933e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:11279:x1875870732093824:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788970031.729728:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787933e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:11279:x1875870732093824:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 344us (797us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788970031.729736:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 65 00010000:00010000:0.0:1788970032.197149:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788970033.158047:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970033.158063:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970033.158536:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788970033.158544:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788970033.221941:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788970033.601424:0:12785:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:07:12 (1788970032) 00010000:00010000:0.0:1788970034.244998:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970034.630189:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741508480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970034.630826:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970034.631819:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741508480 00000100:00100000:0.0:1788970034.631831:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741508480 00000100:00100000:0.0:1788970034.631907:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788970034.632290:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778510dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741508480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970034.632345:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970034.632423:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778510dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741508480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970034.632431:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788970034.635346:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970034.635469:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741508480:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788970035.251437:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788970035.251458:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788970035.251478:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788970035.251489:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788970035.257732:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970035.258038:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732094080 00000100:00100000:1.0:1788970035.258052:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732094080 00000100:00100000:1.0:1788970035.258149:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 155 00000100:00100000:3.0:1788970035.258172:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970035.258209:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970035.258234:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970035.258266:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970035.258291:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732094336 00000100:00100000:3.0:1788970035.258295:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732094336 00000100:00100000:3.0:1788970035.258324:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732094208 00000100:00100000:3.0:1788970035.258327:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732094208 00000100:00100000:3.0:1788970035.258364:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:3.0:1788970035.258375:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977861e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732094336:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970035.258477:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977861e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2356:x1875870732094336:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 104us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970035.258484:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00080000:0.0:1788970035.258627:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970035.258634:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970035.258636:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970035.258684:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:3.0:1788970035.258690:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2356:x1875870732094208:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970035.258719:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2356:x1875870732094208:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970035.258748:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:3.0:1788970035.258770:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732093952 00000100:00100000:3.0:1788970035.258774:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732093952 00000100:00100000:0.0:1788970035.258905:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732094464 00000100:00100000:0.0:1788970035.258909:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732094464 00000100:00100000:1.0:1788970035.258978:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778787cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:2356:x1875870732094080:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970035.259022:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778787cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:2356:x1875870732094080:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 49us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970035.259183:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 296 00000100:00100000:3.0:1788970035.259192:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732093952:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970035.259223:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732093952:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 33us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970035.259230:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 296 00000100:00100000:0.0:1788970035.264704:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 156 00000100:00100000:0.0:1788970035.264736:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732094464:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970035.266289:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:2356:x1875870732094464:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 1546us (8006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970035.266309:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 156 00000100:00080000:0.0:1788970035.266363:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970035.269468:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 155 00010000:00010000:0.0:1788970035.270281:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970035.654955:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741508608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970035.655053:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970035.658804:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741508608 00000100:00100000:2.0:1788970035.658829:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741508608 00000100:00100000:2.0:1788970035.658950:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788970035.658967:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741508608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970035.659046:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970035.659169:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741508608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 208us (4116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970035.659178:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788970035.659206:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970035.659264:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741508608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970035.659392:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741508736:0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.659442:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970035.659481:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741509248:0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.659512:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970035.659534:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970035.659540:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741509120:0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.659780:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970035.659831:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741508864:0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.659858:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970035.659879:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970035.659884:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741508992:0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.659905:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970035.659939:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741508736 00000100:00100000:2.0:1788970035.659945:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741508736 00000100:00100000:2.0:1788970035.659985:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788970035.659992:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741508736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.660034:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741508736:12345-0@lo:400:kworker.0 Request processed in 42us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970035.660041:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788970035.660093:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741509248 00000100:00100000:2.0:1788970035.660098:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741509248 00000100:00100000:2.0:1788970035.660136:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741508864 00000100:00100000:2.0:1788970035.660139:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741508864 00000100:00100000:2.0:1788970035.660152:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741508992 00000100:00100000:2.0:1788970035.660154:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741508992 00000100:00100000:2.0:1788970035.660169:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788970035.660174:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741509248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.660207:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741509248:12345-0@lo:400:kworker.0 Request processed in 33us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970035.660212:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788970035.660224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788970035.660229:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741508864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.660256:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741508864:12345-0@lo:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970035.660262:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788970035.660274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788970035.660279:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741508992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.660303:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741508992:12345-0@lo:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970035.660308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788970035.660329:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741509120 00000100:00100000:2.0:1788970035.660333:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741509120 00000100:00100000:2.0:1788970035.660365:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788970035.660372:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741509120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.660405:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741509120:12345-0@lo:400:kworker.0 Request processed in 34us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970035.660421:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788970035.660470:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970035.660498:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741508992:0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.660509:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741508864:0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.660542:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741509120:0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.660550:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741508736:0@lo:400:kworker.0 00000100:00100000:2.0:1788970035.661226:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741509248:0@lo:400:kworker.0 00010000:00010000:0.0:1788970036.293081:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970036.382085:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970036.382203:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732094592 00000100:00100000:2.0:1788970036.382218:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732094592 00000100:00100000:2.0:1788970036.382290:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 238 00000100:00100000:2.0:1788970036.382300:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+5:12301:x1875870732094592:12345-192.168.202.9@tcp:101:lsof.0 00010000:00010000:2.0:1788970036.382329:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970036.382358:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4ab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec40 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970036.382550:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4ab7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970036.382615:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970036.382631:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970036.382684:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788970036.382690:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970036.382767:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970036.382841:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c400/0x5d0de860b05b4ab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec40 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970036.382864:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec40 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970036.382872:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c500) 00010000:00010000:2.0:1788970036.382874:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970036.382877:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c600, rc 0) 00000100:00100000:2.0:1788970036.383009:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:12301:x1875870732094592:12345-192.168.202.9@tcp:101:lsof.0 Request processed in 710us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970036.383014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 238 00010000:00010000:0.0:1788970037.317278:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970038.342258:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970038.515175:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970038.515295:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732094848 00000100:00100000:2.0:1788970038.515316:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732094848 00000100:00100000:2.0:1788970038.515422:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:2.0:1788970038.515437:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+18:12302:x1875870732094848:12345-192.168.202.9@tcp:35:umount.0 00000100:00080000:0.0:1788970038.516469:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970038.516662:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:12302:x1875870732094848:12345-192.168.202.9@tcp:35:umount.0 Request processed in 1226us (1499us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788970038.516673:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 66 00000100:00100000:0.0:1788970038.528784:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970038.529675:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732095104 00000100:00100000:2.0:1788970038.529690:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732095104 00000100:00100000:2.0:1788970038.529774:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:2.0:1788970038.529784:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+19:12302:x1875870732095104:12345-192.168.202.9@tcp:35:umount.0 00000100:00100000:2.0:1788970038.530367:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:12302:x1875870732095104:12345-192.168.202.9@tcp:35:umount.0 Request processed in 582us (1592us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788970038.530390:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 67 00000100:00100000:1.0:1788970038.541780:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970038.542002:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732095360 00000100:00100000:2.0:1788970038.542016:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732095360 00000100:00100000:2.0:1788970038.542087:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:2.0:1788970038.542097:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778507ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+20:12302:x1875870732095360:12345-192.168.202.9@tcp:35:umount.0 00000100:00100000:2.0:1788970038.542317:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778507ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:12302:x1875870732095360:12345-192.168.202.9@tcp:35:umount.0 Request processed in 221us (561us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788970038.542324:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 68 00000100:00100000:0.0:1788970038.564213:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970038.564369:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732095616 00000100:00100000:2.0:1788970038.564380:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732095616 00000100:00100000:2.0:1788970038.564440:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:2.0:1788970038.564451:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+21:12302:x1875870732095616:12345-192.168.202.9@tcp:35:umount.0 00000100:00100000:2.0:1788970038.565234:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:12302:x1875870732095616:12345-192.168.202.9@tcp:35:umount.0 Request processed in 783us (1028us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788970038.565243:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 69 00000100:00100000:0.0:1788970038.575764:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970038.575869:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970038.578254:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970038.579264:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732095744 00000100:00100000:3.0:1788970038.579277:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732095744 00000100:00100000:3.0:1788970038.579401:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732096128 00000100:00100000:3.0:1788970038.579404:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732096128 00000100:00100000:0.0:1788970038.580567:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970038.584399:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732095872 00000100:00100000:2.0:1788970038.584414:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732095872 00000100:00100000:2.0:1788970038.584491:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1788970038.584513:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+15:2356:x1875870732095744:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970038.584532:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970038.584563:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840031400/0x5d0de860b05b3adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7d2 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970038.584582:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970038.584657:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+14:2356:x1875870732095744:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 157us (8903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970038.584680:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1788970038.584700:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1788970038.584706:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+13:2356:x1875870732096128:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970038.584716:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970038.584725:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5a00/0x5d0de860b05b3d51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e89d expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970038.584734:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970038.584752:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+12:2356:x1875870732096128:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 46us (8883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970038.584758:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1788970038.584772:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1788970038.584777:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:2356:x1875870732095872:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970038.584784:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970038.584836:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5000/0x5d0de860b05b3aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e79a expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970038.584845:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970038.584862:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2356:x1875870732095872:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 85us (6618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970038.584869:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1788970038.585071:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732096384 00000100:00100000:2.0:1788970038.585077:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732096384 00000100:00100000:2.0:1788970038.585113:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 72 00000100:00100000:2.0:1788970038.585121:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2352:x1875870732096384:12345-192.168.202.9@tcp:9:umount.0 00000020:00000080:2.0:1788970038.585154:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b407d 00000020:00010000:2.0:1788970038.585161:0:6676:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97787882a800: total 0 00000100:00080000:2.0:1788970038.585166:0:6676:0:(import.c:65:import_set_state_nolock()) ffff97787882d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970038.585204:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788970038.585452:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2352:x1875870732096384:12345-192.168.202.9@tcp:9:umount.0 Request processed in 331us (4891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970038.585460:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 72 00000020:00010000:2.0:1788970038.585481:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97787882a800: total 0 00010000:00010000:2.0:1788970038.585500:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97787882a800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788970038.585537:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4aa9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec39 expref: 4 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970038.585568:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4419 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea72 expref: 3 pid: 8534 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970038.585582:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97787882a800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788970038.585594:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970038.585596:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970038.585598:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970038.585605:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970038.601173:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970038.602545:0:8534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732096512 00000100:00100000:2.0:1788970038.602558:0:8534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732096512 00000100:00100000:2.0:1788970038.602653:0:8534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:2.0:1788970038.602664:0:8534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+5:2352:x1875870732096512:12345-192.168.202.9@tcp:9:umount.0 00000020:00000080:2.0:1788970038.602693:0:8534:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3e15 00000100:00080000:2.0:1788970038.602701:0:8534:0:(import.c:65:import_set_state_nolock()) ffff97784eb77000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970038.602746:0:8534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1788970038.602934:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970038.603057:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970038.603094:0:8534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7778032-abf5-4f7d-b43e-a87bfd7b090c+2:2352:x1875870732096512:12345-192.168.202.9@tcp:9:umount.0 Request processed in 431us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970038.603102:0:8534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 73 00000100:00100000:1.0:1788970038.623326:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970038.623632:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732097536 00000100:00100000:2.0:1788970038.623641:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732097536 00000100:00100000:2.0:1788970038.623691:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 239 00000100:00100000:2.0:1788970038.623700:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+22:2352:x1875870732097536:12345-192.168.202.9@tcp:39:umount.0 00000020:00000080:2.0:1788970038.623734:0:5834:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3ab1 00000020:00010000:2.0:1788970038.623750:0:5834:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97787f948800: total 0 00000100:00080000:2.0:1788970038.623754:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97784eb71000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970038.623780:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1788970038.623822:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97787f948800: total 0 00010000:00010000:0.0:1788970038.623827:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970038.623935:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97787f948800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788970038.623973:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970038.623989:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788970038.623996:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93200/0x5d0de860b05b4404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea6b expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624013:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970038.624015:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970038.624017:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484000/0x5d0de860b05b43da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea5d expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624026:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff977843e0b300) 00010000:00010000:1.0:1788970038.624027:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970038.624039:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c200/0x5d0de860b05b3d7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8ab expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624315:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970038.624319:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970038.624324:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b4a6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec24 expref: 18 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624337:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c500) 00010000:00010000:1.0:1788970038.624339:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970038.624343:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dd600/0x5d0de860b05b446d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea87 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624356:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:1.0:1788970038.624358:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970038.624362:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778821dce00/0x5d0de860b05b40d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e999 expref: 16 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624388:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9778519abd00) 00010000:00010000:1.0:1788970038.624391:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970038.624395:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484200/0x5d0de860b05b42fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea25 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624409:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff977849672700) 00010000:00010000:1.0:1788970038.624411:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788970038.624415:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484c00/0x5d0de860b05b3deb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8c7 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624427:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970038.624429:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788970038.624433:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484400/0x5d0de860b05b4a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec32 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624443:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff977849672800) 00010000:00010000:1.0:1788970038.624445:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970038.624449:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f484a00/0x5d0de860b05b498a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ebec expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624461:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970038.624464:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788970038.624468:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b4489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ea8e expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624478:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab200) 00010000:00010000:1.0:1788970038.624481:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970038.624490:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b3d97 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e8b2 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624505:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970038.624507:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970038.624511:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b4768 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eb60 expref: 9 pid: 7061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970038.624524:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97787f948800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788970038.624662:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970038.624665:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970038.624667:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970038.625674:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7778032-abf5-4f7d-b43e-a87bfd7b090c+7:2352:x1875870732097536:12345-192.168.202.9@tcp:39:umount.0 Request processed in 1969us (2353us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788970038.625686:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 239 00010000:00010000:1.0:1788970039.365520:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970039.749129:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970039.749155:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741509376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970039.749222:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970039.749371:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741509376 00000100:00100000:1.0:1788970039.749381:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741509376 00000100:00080000:2.0:1788970039.749431:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970039.749455:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788970039.749465:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741509376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970039.749499:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970039.749552:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741509376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970039.749560:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788970039.749597:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741509376:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788970039.811419:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:0.0:1788970039.811426:0:6702:0:(genops.c:885:class_export_put()) final put ffff97784eb70000/c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:1.0:1788970039.811695:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97784eb70000/c7778032-abf5-4f7d-b43e-a87bfd7b090c for lustre-OST0000 00000020:00000080:1.0:1788970039.811751:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97784eb77000 for lustre-OST0000 00000001:00100000:1.0:1788970040.348913:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000001:00080000:1.0:1788970040.348931:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788970040.348944:0:5854:0:(genops.c:885:class_export_put()) final put ffff97787f948800/c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:3.0:1788970040.350253:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f948800/c7778032-abf5-4f7d-b43e-a87bfd7b090c for lustre-MDT0000 00000020:00000080:3.0:1788970040.350334:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97784eb71000 for lustre-MDT0000 00000100:00100000:0.0:1788970040.383135:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970040.383180:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970040.383292:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732097664 00000100:00100000:2.0:1788970040.383303:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732097664 00000100:00100000:2.0:1788970040.383367:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 298 00000100:00100000:2.0:1788970040.383378:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870732097664:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970040.383451:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2355:x1875870732097664:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 75us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970040.383459:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 298 00000100:00100000:3.0:1788970040.383732:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732097792 00000100:00100000:3.0:1788970040.383737:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732097792 00000100:00100000:3.0:1788970040.383849:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 160 00000100:00100000:3.0:1788970040.383859:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:2355:x1875870732097792:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970040.383918:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:2355:x1875870732097792:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 61us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970040.383924:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 160 00000100:00080000:0.0:1788970040.385135:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788970040.392463:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788970040.400971:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:3.0:1788970040.400981:0:7615:0:(genops.c:885:class_export_put()) final put ffff97787882a800/c7778032-abf5-4f7d-b43e-a87bfd7b090c 00000020:00000080:1.0:1788970040.401551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787882a800/c7778032-abf5-4f7d-b43e-a87bfd7b090c for lustre-OST0001 00000020:00000080:1.0:1788970040.405212:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787882d800 for lustre-OST0001 00000100:00100000:0.0:1788970040.451486:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970040.451547:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970040.451834:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732097920 00000100:00100000:1.0:1788970040.451846:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732097920 00000100:00100000:1.0:1788970040.451907:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732098048 00000100:00100000:1.0:1788970040.451910:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732098048 00000100:00100000:1.0:1788970040.451938:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:1.0:1788970040.451947:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+11:2353:x1875870732097920:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970040.451962:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970040.451981:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840030800/0x5d0de860b05b3b83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7e7 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970040.451999:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970040.452060:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+10:2353:x1875870732097920:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 113us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970040.452067:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:1.0:1788970040.452085:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:1.0:1788970040.452090:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+9:2353:x1875870732098048:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970040.452098:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970040.452105:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5400/0x5d0de860b05b3b8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e811 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970040.452114:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970040.452129:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:2353:x1875870732098048:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 39us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970040.452135:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:0.0:1788970040.453362:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970040.453555:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732098176 00000100:00100000:2.0:1788970040.453562:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732098176 00000100:00100000:2.0:1788970040.453620:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:2.0:1788970040.453629:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+8:2354:x1875870732098176:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970040.453641:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970040.453654:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44de00/0x5d0de860b05b3d4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e896 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970040.453668:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970040.453716:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+7:2354:x1875870732098176:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 87us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970040.453722:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:1.0:1788970040.470181:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970040.470471:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732098432 00000100:00100000:0.0:1788970040.470499:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732098432 00000100:00100000:2.0:1788970040.470674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 240 00000100:00100000:2.0:1788970040.470687:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+6:2352:x1875870732098432:12345-192.168.202.9@tcp:39:umount.0 00000020:00000080:2.0:1788970040.470729:0:5834:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3b98 00000020:00010000:2.0:1788970040.470741:0:5834:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97787882e000: total 0 00000100:00080000:2.0:1788970040.470746:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97787882b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970040.470782:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1788970040.470847:0:5820:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97787882e000: total 0 00010000:00010000:1.0:1788970040.470909:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97787882e000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788970040.470942:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c500) 00010000:00010000:1.0:1788970040.470951:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970040.470959:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c600/0x5d0de860b05b4ab7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec40 expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970040.470987:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97787882e000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788970040.470999:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970040.471001:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970040.471003:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970040.471262:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4820ff5c-59fe-4420-a2a6-abcfc7a3612a+3:2352:x1875870732098432:12345-192.168.202.9@tcp:39:umount.0 Request processed in 577us (1091us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788970040.471271:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 240 00000100:00100000:3.0:1788970040.516006:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970040.516151:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732098688 00000100:00100000:2.0:1788970040.516162:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732098688 00000100:00100000:2.0:1788970040.516235:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 299 00000100:00100000:2.0:1788970040.516245:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+7:2352:x1875870732098688:12345-192.168.202.9@tcp:251:umount.0 00000020:00000080:2.0:1788970040.516293:0:5825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3a8e 00000020:00010000:2.0:1788970040.516309:0:5825:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97787f94e000: total 0 00000100:00080000:2.0:1788970040.516313:0:5825:0:(import.c:65:import_set_state_nolock()) ffff97787f94f000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788970040.516400:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:537f4ae5-7bf7-40b1-8a87-b6178a7df48c+3:2352:x1875870732098688:12345-192.168.202.9@tcp:251:umount.0 Request processed in 155us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970040.516416:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 299 00000020:00010000:1.0:1788970040.516887:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97787f94e000: total 0 00010000:00010000:1.0:1788970040.516968:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970040.517028:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97787f94e000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788970040.517064:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841544400/0x5d0de860b05b3ae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4e7d9 expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970040.517078:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97787f94e000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788970040.517088:0:5821:0:(genops.c:885:class_export_put()) final put ffff97787f94e000/537f4ae5-7bf7-40b1-8a87-b6178a7df48c 00010000:00010000:1.0:1788970040.517103:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970040.517105:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970040.517107:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788970040.517493:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f94e000/537f4ae5-7bf7-40b1-8a87-b6178a7df48c for MGS 00000020:00000080:3.0:1788970040.517539:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f94f000 for MGS 00000100:00100000:2.0:1788970040.773926:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970040.773997:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970040.774082:0:11282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741509504 00000100:00100000:2.0:1788970040.774091:0:11282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741509504 00000100:00100000:2.0:1788970040.774151:0:11282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788970040.774161:0:11282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741509504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970040.774195:0:11282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970040.774254:0:11282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741509504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970040.774260:0:11282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788970040.774282:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970040.774321:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970040.774739:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741509760:0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.774776:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970040.774836:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788970040.774842:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741509632:0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.774869:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970040.774894:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741510144:0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.774915:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970040.774942:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741509632 00000100:00100000:0.0:1788970040.774946:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741509632 00000100:00100000:0.0:1788970040.774975:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788970040.774982:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741509632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775027:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3284:x1875870741509632:12345-0@lo:400:kworker.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970040.775034:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788970040.775058:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a31680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741509888:0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775078:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970040.775094:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970040.775099:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741510016:0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775116:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970040.775140:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741510016 00000100:00100000:0.0:1788970040.775143:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741510016 00000100:00100000:0.0:1788970040.775168:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788970040.775174:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741510016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775202:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741510016:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970040.775236:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788970040.775266:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741510016:0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775281:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741509632:0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775298:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741509760 00000100:00100000:0.0:1788970040.775301:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741509760 00000100:00100000:0.0:1788970040.775322:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741510144 00000100:00100000:0.0:1788970040.775324:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741510144 00000100:00100000:0.0:1788970040.775338:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741509888 00000100:00100000:0.0:1788970040.775340:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741509888 00000100:00100000:0.0:1788970040.775351:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788970040.775356:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741509760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775383:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741509760:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970040.775389:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788970040.775527:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788970040.775534:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741510144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775560:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741510144:12345-0@lo:400:kworker.0 Request processed in 28us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970040.775566:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788970040.775575:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788970040.775579:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741509888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775602:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741509888:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970040.775607:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1788970040.775622:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970040.775642:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a31680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741509888:0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775658:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741510144:0@lo:400:kworker.0 00000100:00100000:0.0:1788970040.775666:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741509760:0@lo:400:kworker.0 00010000:00010000:1.0:1788970041.418409:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788970042.110573:0:12990:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788970042.126511:0:12990:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788970042.126560:0:12990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.126575:0:12990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.126582:0:12990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.126609:0:12990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.126642:0:12990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788970042.126649:0:12990:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788970042.126677:0:12990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788970042.126682:0:12990:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788970042.126687:0:12990:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788970042.126711:0:12990:0:(import.c:65:import_set_state_nolock()) ffff9778507ed800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788970042.126762:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970042.126768:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970042.126775:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9200 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970042.126778:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970042.126811:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970042.126818:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970042.126823:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970042.126826:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788970042.126828:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788970042.126854:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970042.126860:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970042.126881:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970042.126888:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778414a9200/0x5d0de860b05b3b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b28 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970042.126900:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970042.126902:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970042.126909:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970042.126917:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970042.126934:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f4652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741510400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970042.126993:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970042.127067:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741510400 00000100:00100000:3.0:1788970042.127074:0:11142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741510400 00000100:00100000:3.0:1788970042.127121:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970042.127142:0:11142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3283:x1875870741510400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970042.127154:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970042.127168:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5e00/0x5d0de860b05b3b28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3b21 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970042.127180:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970042.127216:0:11142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3283:x1875870741510400:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970042.127223:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970042.127301:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f4652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:3283:1875870741510400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970042.127471:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741510272:0@lo:39:umount.0 00000100:00100000:0.0:1788970042.127504:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970042.127566:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741510272 00000100:00100000:1.0:1788970042.127571:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741510272 00000100:00100000:1.0:1788970042.127609:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788970042.127616:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880d40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875870741510272:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788970042.127636:0:5834:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b38ab 00000100:00080000:1.0:1788970042.127643:0:5834:0:(import.c:65:import_set_state_nolock()) ffff977865004000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788970042.127698:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880d40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3282:x1875870741510272:12345-0@lo:39:umount.0 Request processed in 83us (193us total) trans 0 rc 0/0 00010000:00010000:0.0:1788970042.127702:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970042.127705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1788970042.127711:0:5834:0:(genops.c:885:class_export_put()) final put ffff977865007000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788970042.127719:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778507ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788970042.127727:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741510272:0@lo:39:umount.0 00000100:00080000:1.0:1788970042.127733:0:12990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788970042.127735:0:12990:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788970042.127739:0:12990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788970042.128633:0:12990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128647:0:12990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128673:0:12990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128679:0:12990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128706:0:12990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970042.128712:0:12990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128717:0:12990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128723:0:12990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128728:0:12990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128738:0:12990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788970042.128743:0:12990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128750:0:12990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128757:0:12990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128774:0:12990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128782:0:12990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788970042.128818:0:12990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128825:0:12990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.128830:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788970042.128831:0:12990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.128836:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970042.128837:0:12990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.128843:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8200 already unused, calling callback (ffffffffc1cf3c20) 00010000:00010000:1.0:1788970042.128845:0:12990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788970042.128847:0:12990:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:0.0:1788970042.128847:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.128855:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970042.128861:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970042.128867:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970042.128869:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:01000004:1.0:1788970042.128871:0:12990:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 10000000:01000000:0.0:1788970042.128871:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000000:1.0:1788970042.128876:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788970042.128880:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970042.128884:0:12990:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1788970042.128890:0:12990:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97787f499800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788970042.128896:0:12990:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97787f7e5800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788970042.128903:0:12990:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff97787882e000 4820ff5c-59fe-4420-a2a6-abcfc7a3612a 192.168.202.9@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788970042.128909:0:12990:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9778652ab380) has exports, disconnecting them 00000020:00080000:1.0:1788970042.128914:0:12990:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97787f499800), last request at 1788970040 00000020:00000080:1.0:1788970042.128926:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3a10 00000100:00080000:1.0:1788970042.128943:0:12990:0:(import.c:65:import_set_state_nolock()) ffff97787f49b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788970042.128991:0:12990:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97787f499800): rc 0 00000020:00000080:1.0:1788970042.128994:0:12990:0:(genops.c:885:class_export_put()) final put ffff97787f499800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788970042.129011:0:12990:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97787f7e5800), last request at 1788970040 00000020:00000080:1.0:1788970042.129014:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3945 00000100:00080000:1.0:1788970042.129019:0:12990:0:(import.c:65:import_set_state_nolock()) ffff97787f7e6800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788970042.129024:0:12990:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97787f7e5800): rc 0 00000020:00000080:1.0:1788970042.129026:0:12990:0:(genops.c:885:class_export_put()) final put ffff97787f7e5800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788970042.129034:0:12990:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc26c18fbae0 00000100:00080000:1.0:1788970042.129052:0:12990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788970042.129055:0:12990:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788970042.129074:0:12990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788970042.129133:0:12990:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788970042.129146:0:12990:0:(import.c:65:import_set_state_nolock()) ffff97787882a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788970042.129149:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788970042.129162:0:12990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788970042.129164:0:12990:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:0.0:1788970042.129167:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:1.0:1788970042.129173:0:12990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1788970042.129184:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129190:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778414a8200/0x5d0de860b05b3b2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129202:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788970042.129205:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129210:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5800 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788970042.129214:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788970042.129236:0:12990:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788970042.129244:0:12990:0:(import.c:65:import_set_state_nolock()) ffff97787f94d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788970042.129280:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9778652ab380) has no exports 00010000:00010000:0.0:1788970042.129341:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970042.129347:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970042.129351:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970042.129353:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788970042.129355:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788970042.129370:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129376:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970042.129382:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129398:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5800/0x5d0de860b05b3a48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3a4f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129412:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970042.129415:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129421:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93c00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788970042.129423:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129430:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970042.129435:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970042.129440:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788970042.129442:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788970042.129444:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788970042.129456:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129462:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970042.129484:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129490:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977880f93c00/0x5d0de860b05b3d3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3d43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788970042.129536:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff977865007000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788970042.129580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f499800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788970042.129603:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f7e5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788970042.129626:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff977865004000 for lustre-MDT0000 00000020:00000080:3.0:1788970042.129631:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f49b000 for lustre-MDT0000 00000020:00000080:3.0:1788970042.129634:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f7e6800 for lustre-MDT0000 00010000:00010000:0.0:1788970042.129849:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970042.129855:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129861:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545800 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788970042.129864:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129873:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970042.129880:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970042.129885:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970042.129887:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788970042.129888:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788970042.129903:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129909:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970042.129915:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129921:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545800/0x5d0de860b05b37fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3803 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.129933:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970042.129934:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970042.129941:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970042.129958:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878a31680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741510528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970042.130023:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970042.130077:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970042.130083:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741510912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970042.130105:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970042.130133:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741511168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970042.130153:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970042.130168:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970042.130173:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741511040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970042.130189:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970042.130215:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741510528 00000100:00100000:0.0:1788970042.130222:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741510528 00000100:00100000:0.0:1788970042.130256:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741510912 00000100:00100000:0.0:1788970042.130259:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741510912 00000100:00100000:0.0:1788970042.130268:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741511168 00000100:00100000:0.0:1788970042.130270:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741511168 00000100:00100000:0.0:1788970042.130281:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741511040 00000100:00100000:0.0:1788970042.130283:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741511040 00000100:00100000:0.0:1788970042.130295:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970042.130302:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+21:3285:x1875870741510528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970042.130313:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970042.130325:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5200/0x5d0de860b05b3b36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3b2f expref: 21 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.130336:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970042.130366:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+20:3285:x1875870741510528:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970042.130372:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970042.130395:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970042.130400:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+19:3285:x1875870741510912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970042.130407:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970042.130414:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9000/0x5d0de860b05b3a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3a48 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.130426:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970042.130446:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+18:3285:x1875870741510912:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970042.130451:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970042.130462:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788970042.130468:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+17:3284:x1875870741511168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970042.130475:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970042.130482:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9800/0x5d0de860b05b3803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b37fc expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.130492:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970042.130514:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+16:3284:x1875870741511168:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970042.130520:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788970042.130532:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970042.130537:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+15:3284:x1875870741511040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970042.130544:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970042.130551:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4e00/0x5d0de860b05b3d43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3d3c expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970042.130564:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970042.130591:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3284:x1875870741511040:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970042.130596:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970042.130627:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741511040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970042.130634:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741511168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970042.130653:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741510656:0@lo:9:umount.0 00000100:00100000:0.0:1788970042.130678:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970042.130694:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741510784:0@lo:9:umount.0 00000100:00100000:0.0:1788970042.130710:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970042.130733:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970042.130746:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741510912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970042.130753:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878a31680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741510528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970042.130764:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741510656 00000100:00100000:3.0:1788970042.130768:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741510656 00000100:00100000:3.0:1788970042.130837:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741510784 00000100:00100000:3.0:1788970042.130840:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741510784 00000100:00100000:3.0:1788970042.130861:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788970042.130875:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875870741510656:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788970042.130896:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3992 00000100:00080000:3.0:1788970042.130903:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9778601f8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970042.130931:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788970042.131263:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3282:x1875870741510656:12345-0@lo:9:umount.0 Request processed in 389us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970042.131270:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788970042.131284:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788970042.131290:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875870741510784:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788970042.131303:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3a79 00000100:00080000:3.0:1788970042.131309:0:6679:0:(import.c:65:import_set_state_nolock()) ffff97787f94b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970042.131327:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788970042.131633:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3282:x1875870741510784:12345-0@lo:9:umount.0 Request processed in 344us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970042.131639:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1788970042.131724:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788970042.131744:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787882a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788970042.131755:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788970042.131757:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970042.131760:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741510656:0@lo:9:umount.0 00000100:00080000:3.0:1788970042.131769:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787f94d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788970042.131772:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788970042.131774:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970042.131775:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741510784:0@lo:9:umount.0 00010000:00010000:3.0:1788970042.131819:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970042.133510:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970042.133517:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1788970042.145775:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9778652ab380) has no exports 00000020:00000080:1.0:1788970042.203265:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3857 00000020:00000080:1.0:1788970042.203283:0:12990:0:(genops.c:885:class_export_put()) final put ffff9778457fb800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788970042.203342:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788970042.203481:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9778457fb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788970042.203578:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970042.203588:0:12990:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788970042.203593:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9778652fb380) has no exports 00000020:00000080:0.0:1788970042.204172:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3850 00000020:00000080:0.0:1788970042.204178:0:12990:0:(genops.c:885:class_export_put()) final put ffff97787a5b8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788970042.204231:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a5b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788970042.204285:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970042.204292:0:12990:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788970042.204294:0:12990:0:(genops.c:885:class_export_put()) final put ffff97786166d000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788970042.204296:0:12990:0:(genops.c:844:class_export_destroy()) destroying export ffff97786166d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788970042.204301:0:12990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788970042.436977:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970043.461079:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970044.484965:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788970044.956616:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788970044.956628:0:6702:0:(genops.c:885:class_export_put()) final put ffff97787f51f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970044.956772:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f51f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788970044.956913:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778601f8800 for lustre-OST0000 00000001:00100000:1.0:1788970045.422025:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4820ff5c-59fe-4420-a2a6-abcfc7a3612a 00000001:00080000:1.0:1788970045.422041:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788970045.422047:0:5854:0:(genops.c:885:class_export_put()) final put ffff97787882e000/4820ff5c-59fe-4420-a2a6-abcfc7a3612a 00000020:00000080:1.0:1788970045.422072:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787882e000/4820ff5c-59fe-4420-a2a6-abcfc7a3612a for lustre-MDT0000 00000020:00000080:1.0:1788970045.422131:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787882b000 for lustre-MDT0000 00000001:00100000:3.0:1788970045.433742:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970045.433752:0:7615:0:(genops.c:885:class_export_put()) final put ffff97787f949800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788970045.433855:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f949800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788970045.433905:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f94b800 for lustre-OST0001 00010000:00010000:3.0:1788970045.509014:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970045.894226:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f4652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741511296:0@lo:400:kworker.0 00000100:00100000:0.0:1788970045.894307:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970045.894437:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741511424:0@lo:400:kworker.0 00000100:00100000:2.0:1788970045.894471:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741511296 00000100:00100000:2.0:1788970045.894479:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741511296 00000100:00100000:1.0:1788970045.894483:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970045.894527:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788970045.894535:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3285:x1875870741511296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970045.894553:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970045.894561:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741511552:0@lo:400:kworker.0 00000100:00100000:2.0:1788970045.894584:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784c15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d87485c-d221-41b3-b6c0-56f4dfc97796+14:3285:x1875870741511296:12345-0@lo:400:kworker.0 Request processed in 49us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970045.894587:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970045.894591:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788970045.894612:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741511424 00000100:00100000:3.0:1788970045.894616:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741511424 00000100:00100000:3.0:1788970045.894636:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788970045.894641:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3286:x1875870741511424:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788970045.894646:0:5833:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788970045.894650:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f4652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741511296:0@lo:400:kworker.0 00000100:00100000:0.0:1788970045.894724:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741511552 00000100:00100000:0.0:1788970045.894728:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741511552 00000100:00100000:0.0:1788970045.894751:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788970045.894756:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3284:x1875870741511552:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788970045.894761:0:7061:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788970045.894806:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3284:x1875870741511552:12345-0@lo:400:kworker.0 Request processed in 48us (217us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788970045.894812:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1788970045.894914:0:3284:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788970045.894919:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788970045.894923:0:3284:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788970045.898186:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3286:x1875870741511424:12345-0@lo:400:kworker.0 Request processed in 3531us (3689us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788970045.898202:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:1.0:1788970045.908852:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788970045.908997:0:3286:0:(import.c:65:import_set_state_nolock()) ffff97787f7e5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788970045.909002:0:3286:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788970045.909008:0:3286:0:(import.c:65:import_set_state_nolock()) ffff97787f7e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970045.909012:0:3286:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 159 00000100:00080000:1.0:1788970045.909024:0:3286:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97787f7e5000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1788970045.909061:0:3286:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778650c0b40 x1875870741511680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970045.909094:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741511424:0@lo:400:kworker.0 00000100:00100000:3.0:1788970045.909244:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741511680:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788970045.909312:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970045.911086:0:7061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741511680 00000100:00100000:0.0:1788970045.911099:0:7061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741511680 00000100:00100000:0.0:1788970045.911167:0:7061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788970045.911175:0:7061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3282:x1875870741511680:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788970045.911193:0:7061:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788970045.917269:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970045.917278:0:3284:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 179 00000100:00080000:2.0:1788970045.917292:0:3284:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9778792c8000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970045.917334:0:3284:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff412c0 x1875870741511808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970045.917382:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741511552:0@lo:400:kworker.0 00000100:00100000:3.0:1788970045.917523:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741511808:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788970045.917605:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970045.917699:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741511808 00000100:00100000:1.0:1788970045.917708:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741511808 00000100:00100000:1.0:1788970045.917755:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788970045.917762:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875870741511808:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788970045.917779:0:5832:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788970045.917846:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875870741511808:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 83us (239us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788970045.917853:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788970045.922147:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970045.922161:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788970045.922167:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741511808:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788970045.942191:0:7061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3282:x1875870741511680:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 31009us (32871us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970045.942207:0:7061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788970045.943043:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787f7e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970045.943051:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788970045.943056:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741511680:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1788970046.533060:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970047.557494:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788970048.261016:0:12990:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977852cfb300 - data ffff97786edf0ca8/ffff97787f386c00 00000020:01000000:0.0:1788970048.261155:0:12990:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977878e41600 - data ffff97786ec33ca8/ffff97784eb28800 00000001:00000004:0.0:1788970048.267283:0:12990:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788970048.376859:0:12990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788970048.376868:0:12990:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788970048.376894:0:12990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788970048.376897:0:12990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788970048.377456:0:7059:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788970048.377462:0:7059:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788970048.377471:0:7059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788970048.379023:0:12990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788970048.379031:0:12990:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788970048.379048:0:12990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788970048.379061:0:12990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788970048.379458:0:8142:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788970048.379462:0:8142:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788970048.379471:0:8142:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788970048.448754:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b381f 00000020:00000080:0.0:1788970048.448765:0:12990:0:(genops.c:885:class_export_put()) final put ffff977879427000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788970048.454876:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff977879427000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788970048.455448:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3834 00000020:00000080:2.0:1788970048.455459:0:12990:0:(genops.c:885:class_export_put()) final put ffff977879426800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788970048.455612:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788970048.455619:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970048.455645:0:12990:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788970048.455649:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9778652a8000) has no exports 00000004:01000000:2.0:1788970048.455907:0:12990:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788970048.455916:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3a72 00000020:00000080:2.0:1788970048.455921:0:12990:0:(genops.c:885:class_export_put()) final put ffff97787f49e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970048.455995:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff977879426800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788970048.456059:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788970048.456064:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970048.456070:0:12990:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788970048.456073:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff977879218000) has no exports 00000020:00000080:2.0:1788970048.456080:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3a6b 00000020:00000080:2.0:1788970048.456084:0:12990:0:(genops.c:885:class_export_put()) final put ffff97787f949000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788970048.456100:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f49e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788970048.456527:0:12990:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788970048.456532:0:12990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788970048.456536:0:12990:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788970048.456542:0:12990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970048.456544:0:12990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970048.456960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f949000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788970048.457225:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970048.457235:0:12990:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788970048.457242:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b398b 00000020:00000080:2.0:1788970048.457248:0:12990:0:(genops.c:885:class_export_put()) final put ffff97787dc92800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970048.457270:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f94d000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788970048.457285:0:8:0:(genops.c:885:class_export_put()) final put ffff9778792ca000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970048.457287:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9778792ca000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788970048.457291:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788970048.457947:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788970048.457955:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970048.457962:0:12990:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788970048.457966:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9778650e8000) has no exports 00000020:00000080:2.0:1788970048.457973:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3984 00000020:00000080:2.0:1788970048.457978:0:12990:0:(genops.c:885:class_export_put()) final put ffff97787882d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788970048.461132:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787dc92800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788970048.463971:0:12990:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788970048.463981:0:12990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788970048.463985:0:12990:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788970048.463996:0:12990:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970048.463999:0:12990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970048.471439:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787882d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788970048.472054:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970048.472080:0:12990:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788970048.472111:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970048.472114:0:12990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788970048.472119:0:12990:0:(genops.c:885:class_export_put()) final put ffff977877f4b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788970048.472122:0:12990:0:(genops.c:844:class_export_destroy()) destroying export ffff977877f4b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788970048.472130:0:12990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788970048.472291:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b383b 00000020:00000080:2.0:1788970048.472298:0:12990:0:(genops.c:885:class_export_put()) final put ffff977879425800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788970048.472304:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788970048.472307:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970048.472312:0:12990:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788970048.472316:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9778652acd40) has no exports 00000020:00000080:3.0:1788970048.472735:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787882a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788970048.472742:0:8:0:(genops.c:885:class_export_put()) final put ffff97787882b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970048.472744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787882b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788970048.472748:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788970048.472906:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff977879425800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788970048.472978:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970048.472983:0:12990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788970048.472987:0:12990:0:(genops.c:885:class_export_put()) final put ffff977879421000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788970048.472989:0:12990:0:(genops.c:844:class_export_destroy()) destroying export ffff977879421000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788970048.472997:0:12990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788970048.473499:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3842 00000020:00000080:2.0:1788970048.473507:0:12990:0:(genops.c:885:class_export_put()) final put ffff977879420000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788970048.473556:0:12990:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97786f03a800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788970048.473560:0:12990:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97786f03a800 3 00000020:01000004:2.0:1788970048.473563:0:12990:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97786f03a800 from lustre-MDT0000 00000020:00000080:2.0:1788970048.473584:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970048.473589:0:12990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788970048.473592:0:12990:0:(genops.c:885:class_export_put()) final put ffff977879420800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788970048.473594:0:12990:0:(genops.c:844:class_export_destroy()) destroying export ffff977879420800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788970048.473602:0:12990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788970048.473626:0:12990:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788970048.473630:0:12990:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788970048.473633:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788970048.473636:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970048.473639:0:12990:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788970048.473651:0:12990:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9778652a4800 1d87485c-d221-41b3-b6c0-56f4dfc97796 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788970048.473658:0:12990:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9778650ecd40) has exports, disconnecting them 00000020:00080000:2.0:1788970048.473662:0:12990:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9778652a4800), last request at 1788969826 00000020:00000080:2.0:1788970048.473676:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b37d9 00000020:00010000:2.0:1788970048.473684:0:12990:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9778652a4800: total 1 00000100:00080000:2.0:1788970048.473689:0:12990:0:(import.c:65:import_set_state_nolock()) ffff9778652a3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788970048.473709:0:12990:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9778652a4800): rc 0 00000020:00080000:2.0:1788970048.473714:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9778650ecd40) has no exports 00000020:00010000:0.0:1788970048.473733:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9778652a4800: total 1 00000100:00100000:2.0:1788970048.473764:0:5825:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff97784564fa00:5825] 0 exiting: rc = 1 00010000:00010000:0.0:1788970048.473764:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9778652a4800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788970048.473806:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840031c00/0x5d0de860b05b3b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3b05 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970048.473821:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840030a00/0x5d0de860b05b3b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3b13 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970048.473832:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5600/0x5d0de860b05b3d27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3d20 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970048.473841:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4a00/0x5d0de860b05b3d35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3d2e expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970048.473858:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b3b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3b3d expref: 5 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970048.473868:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dd000/0x5d0de860b05b38f8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b38f1 expref: 4 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970048.473880:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4000/0x5d0de860b05b3af0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3ae9 expref: 3 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970048.473886:0:5827:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff97784564e400:5827] 2 exiting: rc = 0 00010000:00010000:0.0:1788970048.473889:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977841544e00/0x5d0de860b05b3afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b3af7 expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970048.473900:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9778652a4800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788970048.473911:0:5821:0:(genops.c:885:class_export_put()) final put ffff9778652a4800/1d87485c-d221-41b3-b6c0-56f4dfc97796 00000100:00100000:2.0:1788970048.473934:0:5826:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9778536b1200:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1788970048.474001:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474009:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474014:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474022:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474028:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474038:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474043:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474052:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474057:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474066:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474074:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474080:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474088:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474094:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474103:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474109:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474114:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474122:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474131:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474137:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474146:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474163:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474172:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474181:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474187:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474195:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474201:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474209:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474214:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474221:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474227:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474232:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474241:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474246:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474254:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474260:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474268:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474273:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474282:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474287:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474295:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474300:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474308:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474314:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474321:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474327:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.474332:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475177:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475183:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475192:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475197:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475203:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475212:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475217:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475223:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475232:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475252:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475257:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475266:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475271:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475276:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475285:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475291:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.475297:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788970048.475957:0:12990:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788970048.475960:0:12990:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1788970048.479607:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970048.479681:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970048.479684:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788970048.479753:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff977879420000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788970048.479767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9778652a4800/1d87485c-d221-41b3-b6c0-56f4dfc97796 for MGS 00000020:00000080:3.0:1788970048.481594:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778652a3000 for MGS 00000020:01000000:2.0:1788970048.483021:0:12990:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977842e01840 - data ffff97786eef71b0/ffff97784eb83800 00000020:01000000:2.0:1788970048.483161:0:12990:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977850a63c60 - data ffff97786ec34e58/ffff97784c246800 00000020:00000080:2.0:1788970048.483923:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b37c4 00000020:00000080:2.0:1788970048.483931:0:12990:0:(genops.c:885:class_export_put()) final put ffff977843434000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788970048.483955:0:12990:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97786f03a800 from MGS, refs=2 00000020:01000004:2.0:1788970048.483959:0:12990:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97786f03a800 2 00000020:01000004:2.0:1788970048.483962:0:12990:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97786f03a800 from MGS 00000020:00000080:2.0:1788970048.483985:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970048.483993:0:12990:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788970048.483996:0:12990:0:(genops.c:885:class_export_put()) final put ffff97786166b800/MGS 00000020:00000080:2.0:1788970048.483998:0:12990:0:(genops.c:844:class_export_destroy()) destroying export ffff97786166b800/MGS for MGS 00000020:01000000:2.0:1788970048.484004:0:12990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1788970048.484094:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff977843434000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788970048.484135:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788970048.484139:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970048.484146:0:12990:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788970048.484151:0:12990:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97787a5bd000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788970048.484157:0:12990:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff977850054d40) has exports, disconnecting them 00000020:00080000:2.0:1788970048.484161:0:12990:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97787a5bd000), last request at 1788969827 00000020:00000080:2.0:1788970048.484166:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b388f 00000020:00080000:2.0:1788970048.484175:0:12990:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97787a5bd000): rc 0 00000020:00000080:2.0:1788970048.484179:0:12990:0:(genops.c:885:class_export_put()) final put ffff97787a5bd000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788970048.484436:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a5bd000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788970048.484908:0:12990:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788970048.484913:0:12990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970048.484918:0:12990:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788970048.484923:0:12990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970048.484967:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778507ed800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788970048.485091:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970048.485097:0:12990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788970048.485101:0:12990:0:(genops.c:885:class_export_put()) final put ffff9778507ea000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788970048.485104:0:12990:0:(genops.c:844:class_export_destroy()) destroying export ffff9778507ea000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788970048.485108:0:12990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788970048.485153:0:12990:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97786f03a800 1 00000020:00000080:3.0:1788970048.485157:0:12990:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b37b6 00000020:00000080:3.0:1788970048.485174:0:12990:0:(genops.c:885:class_export_put()) final put ffff97786166e800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788970048.485181:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788970048.485188:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97786166e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788970048.485196:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970048.485200:0:12990:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970048.485203:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff977850053380) has no exports 00000020:00000080:0.0:1788970048.541376:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970048.541391:0:12990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788970048.541398:0:12990:0:(genops.c:885:class_export_put()) final put ffff97786f03c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788970048.541403:0:12990:0:(genops.c:844:class_export_destroy()) destroying export ffff97786f03c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788970048.541414:0:12990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788970048.541702:0:12990:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff977843701800 00000020:01000000:0.0:1788970048.541724:0:12990:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788970048.541729:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970048.541734:0:12990:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788970048.541738:0:12990:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9778652f8000) has no exports 00000100:00100000:0.0:1788970048.541829:0:7061:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff977851e68600:7061] 3 exiting: rc = 0 00000100:00100000:1.0:1788970048.542079:0:5834:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff977850cb6200:5834] 2 exiting: rc = 0 00000100:00100000:1.0:1788970048.542195:0:5832:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff977850cb6e00:5832] 0 exiting: rc = 1 00000100:00100000:0.0:1788970048.542949:0:5833:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff977850cb6400:5833] 1 exiting: rc = 0 00000100:00100000:0.0:1788970048.543019:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543027:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543033:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543050:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543057:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543064:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543072:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543077:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543084:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543090:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543096:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543101:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543106:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543111:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543117:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543123:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543129:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543134:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543139:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543144:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543165:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543173:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543180:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543187:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543193:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543199:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543204:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543210:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543217:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543222:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543228:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543233:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543239:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543244:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543250:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543256:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543274:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543280:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543286:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543292:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543297:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543304:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543309:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543315:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543321:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543326:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543332:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543337:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543342:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543347:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543352:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543358:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543364:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543369:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543375:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543388:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543394:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543399:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543404:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543410:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543416:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543422:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543431:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.543923:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.556024:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff977865088200:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1788970048.556239:0:5835:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff977865089600:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1788970048.556347:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556356:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556362:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556368:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556374:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556380:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556386:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556393:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556399:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556405:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556412:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556418:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556425:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556431:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556436:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556626:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556634:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556640:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556646:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556651:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556657:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556663:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556668:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556674:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556679:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556685:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556699:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556704:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556709:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556714:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556719:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556725:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556730:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556736:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556742:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556747:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556752:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556759:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556765:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556771:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556776:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556782:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556884:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556892:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556898:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556903:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556908:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556914:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556919:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556925:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556931:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556946:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556953:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556959:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556965:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556970:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556976:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556982:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556987:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556993:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.556998:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.557010:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.557015:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.557021:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.557915:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff977860049e00:5837] 0 exiting: rc = 1 00000100:00100000:3.0:1788970048.558025:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff97784c088600:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1788970048.558199:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558209:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558219:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558228:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558248:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558261:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558269:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558274:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558280:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558288:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558295:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558300:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558305:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558312:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558318:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558325:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558356:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558419:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558429:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558437:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558676:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558684:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558690:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558696:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558702:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558707:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558712:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558719:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558742:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558750:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558757:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558763:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558779:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558785:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558881:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558888:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558894:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558900:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558906:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558912:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558948:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558956:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558962:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558969:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558976:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558981:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558987:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.558994:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559000:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559007:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559014:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559020:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559040:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559047:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559052:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559059:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559069:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559077:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559087:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559096:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559105:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559117:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559127:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970048.559140:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970048.576717:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97784c088a00:5839] 0 exiting: rc = 1 00000100:00100000:0.0:1788970048.577012:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff97784c089a00:5840] 1 exiting: rc = 0 00000100:00100000:2.0:1788970048.577139:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577148:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577153:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577159:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577165:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577170:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577176:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577181:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577187:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577192:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577198:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577204:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577211:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577217:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577222:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577228:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577233:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577238:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577244:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577251:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577256:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577261:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577266:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577272:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577277:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577282:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577287:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577292:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577296:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577302:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577307:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577313:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577318:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577323:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577347:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577353:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577358:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577364:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577370:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577377:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577383:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577388:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577393:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577398:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577403:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577409:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577414:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577419:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577424:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577429:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577434:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577622:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577631:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577636:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577642:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577647:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577652:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577657:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577661:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577666:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577671:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577676:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577682:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.577688:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.580922:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff97784c088800:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1788970048.581080:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff97784c088000:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1788970048.581173:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581180:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581185:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581190:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581210:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581216:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581221:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581226:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581232:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581237:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581242:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581248:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581252:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581258:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581263:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581268:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581273:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581278:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581283:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581288:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581293:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581298:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581303:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581308:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581313:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581318:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581322:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581327:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581331:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581335:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581340:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581344:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581349:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581353:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581358:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581362:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581367:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581372:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581377:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581390:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581394:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581399:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581404:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581409:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581414:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581420:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581425:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581430:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581435:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581452:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581458:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581463:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581468:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581473:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581478:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581483:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581488:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581492:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581497:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581502:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581506:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581525:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581530:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.581536:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970048.582452:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff97784c088e00:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1788970048.582784:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff97784c088c00:5843] 0 exiting: rc = 1 00010000:00010000:3.0:1788970048.582879:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970048.582953:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.582962:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.582967:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.582972:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.582977:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.582981:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.582988:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.582992:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.582997:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583005:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583020:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583028:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583036:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583043:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583051:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583059:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583067:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583074:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583082:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583091:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583098:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583105:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583113:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583120:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583127:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583133:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583141:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583151:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583158:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583165:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583175:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583185:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583192:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583197:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583203:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583216:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583255:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583261:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583266:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583270:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583276:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583282:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583288:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583294:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583299:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583311:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583317:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583321:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583327:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583331:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583336:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583341:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583346:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583351:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583357:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583361:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583367:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583372:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583377:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583383:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583389:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583394:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583400:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.583405:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970048.584162:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff977865088c00:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1788970048.586705:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff97784c089800:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1788970048.587144:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff97787815d600:5847] 2 exiting: rc = 0 00000100:00100000:2.0:1788970048.587642:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587651:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587658:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587664:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587670:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587677:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587683:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587687:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587693:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587699:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587721:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587729:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587736:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587743:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587750:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587770:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587776:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587782:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587923:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587931:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587949:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587956:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587962:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587968:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587975:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587983:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587991:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.587997:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588004:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588010:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588016:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588023:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588029:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588035:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588056:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588065:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588073:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588079:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588085:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588091:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588097:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588103:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588110:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588115:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588120:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588126:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588132:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588138:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588144:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588150:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588165:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588170:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588175:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588181:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588186:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588192:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588197:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588203:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588209:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588215:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588220:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588226:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588232:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970048.588245:0:12990:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788970048.597333:0:12990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970048.597348:0:12990:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788970048.597353:0:12990:0:(genops.c:885:class_export_put()) final put ffff97784c1eb000/MDS_uuid 00000020:00000080:2.0:1788970048.597358:0:12990:0:(genops.c:844:class_export_destroy()) destroying export ffff97784c1eb000/MDS_uuid for MDS 00000020:01000000:2.0:1788970048.597364:0:12990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788970048.597660:0:12990:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788970049.607010:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970050.629048:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788970051.013924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788970051.013930:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788970051.013934:0:8:0:(import.c:65:import_set_state_nolock()) ffff97787f7e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970051.013943:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 357 00000100:00080000:3.0:1788970051.013949:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788970051.013960:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97787f7e5000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1788970051.013983:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778812e3480 x1875870741512064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970051.014002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788970051.014005:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788970051.014006:0:8:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970051.014010:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 357 00000100:00080000:3.0:1788970051.014012:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788970051.014027:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9778792c8000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1788970051.014039:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778812e0780 x1875870741512192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970051.014068:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741511936:0@lo:400:kworker.0 00000400:00000100:3.0:1788970051.014119:0:3284:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875870741511936 offset 0 length 224: 4 00000100:00100000:3.0:1788970051.014186:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741512064:0@lo:38:kworker.0 00000400:00000100:3.0:1788970051.014207:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875870741512064 offset 0 length 520: 4 00000100:00100000:3.0:1788970051.014219:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741512192:0@lo:38:kworker.0 00000400:00000100:3.0:1788970051.014235:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875870741512192 offset 0 length 520: 4 00010000:00010000:0.0:1788970051.653055:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788970051.724131:0:13145:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788970051.742088:0:13145:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788970051.742136:0:13145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.742151:0:13145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.742157:0:13145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.742163:0:13145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.742215:0:13145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788970051.742221:0:13145:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788970051.742243:0:13145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788970051.742254:0:13145:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778812e3480 x1875870741512064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970066 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970051.742281:0:13145:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788970051.742289:0:13145:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788970051.742296:0:13145:0:(import.c:65:import_set_state_nolock()) ffff97787f7e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788970051.742301:0:13145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788970051.742304:0:13145:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778812e3480 x1875870741512064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970066 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970051.742310:0:13145:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788970051.742313:0:13145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788970051.742401:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741512064:0@lo:38:kworker.0 00010000:00010000:2.0:1788970051.743451:0:13145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.743464:0:13145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.743470:0:13145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970051.743677:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970051.743685:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.743714:0:13145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.743737:0:13145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970051.743743:0:13145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.743761:0:13145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.743767:0:13145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.743772:0:13145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970051.743779:0:13145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788970051.743782:0:13145:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788970051.743833:0:13145:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788970051.743838:0:13145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788970051.743843:0:13145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970051.743848:0:13145:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788970051.743852:0:13145:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9778652f99c0) has no exports 00000020:00080000:2.0:1788970051.743874:0:13145:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9778652f99c0) has no exports 00010000:00010000:0.0:1788970051.745891:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970051.747029:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970051.747079:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1788970051.749283:0:13145:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97787f4ebcc0 - data ffff97786ec54288/ffff977850c07c00 00000020:01000000:2.0:1788970051.749450:0:13145:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97787f74bba0 - data ffff97787fc170d8/ffff97787f31a000 00010000:00010000:3.0:1788970051.753905:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030c00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970051.753926:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970051.753942:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970051.753950:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970051.753956:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970051.753959:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788970051.753963:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788970051.754015:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970051.754039:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970051.754076:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970051.754083:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977840030c00/0x5d0de860b05b3b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970051.754102:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970051.754104:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970051.754107:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970051.754134:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741512320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970051.754206:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970051.754293:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741512320 00000100:00100000:3.0:1788970051.754300:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741512320 00000100:00100000:3.0:1788970051.754343:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970051.754353:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3285:x1875870741512320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788970051.754359:0:5818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970051 with bad export cookie 6705270922197809113 00010000:00010000:1.0:1788970051.757329:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9600 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788970051.757342:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970051.757357:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970051.757364:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970051.757370:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788970051.757372:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788970051.757376:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788970051.757426:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970051.757433:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970051.757481:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970051.757489:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778414a9600/0x5d0de860b05b3b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3b1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970051.757508:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970051.757510:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970051.757512:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970051.757645:0:13147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970051.757664:0:13147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970051.757666:0:13147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970051.757674:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970051.757681:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8a00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788970051.757683:0:13146:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970051.757689:0:13146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970051.757695:0:13146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970051.757700:0:13146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788970051.757702:0:13146:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788970051.757705:0:13146:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788970051.757720:0:13146:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970051.757726:0:13146:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970051.757740:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970051.757747:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778414a8a00/0x5d0de860b05b3d2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b3d35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970051.757757:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970051.757759:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970051.757760:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970051.765045:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970051.765080:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741512448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970051.765160:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970051.765238:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741512448 00000100:00100000:0.0:1788970051.765247:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741512448 00000100:00100000:0.0:1788970051.765292:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970051.765300:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3285:x1875870741512448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788970051.765306:0:5817:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970051 with bad export cookie 6705270922197809113 00000100:00100000:0.0:1788970051.765356:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3285:x1875870741512448:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (196us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788970051.765362:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788970051.765402:0:3285:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788970051.765406:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9778652a2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788970051.765410:0:3285:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.109@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788970051.771382:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3285:x1875870741512320:12345-0@lo:103:ldlm_bl.0 Request processed in 17024us (17170us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788970051.771396:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788970051.794624:0:3285:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.109@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788970051.794629:0:3285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788970051.794638:0:3285:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778812e0000 x1875870741511936/t0(0) o400->MGC192.168.202.109@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788970067 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970051.794779:0:3285:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778812e2580 x1875870741512320/t0(0) o103->MGC192.168.202.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970067 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970051.794897:0:3285:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778650c1680 x1875870741512448/t0(0) o103->MGC192.168.202.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970067 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970051.796316:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d87485c-d221-41b3-b6c0-56f4dfc97796:0:1875870741512576:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1788970051.797314:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788970051.797320:0:3285:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788970051.797333:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788970051.797337:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9778652a2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970051.797344:0:3285:0:(import.c:545:import_select_connection()) MGC192.168.202.109@tcp: connect to NID 0@lo last attempt 138 00000100:00080000:0.0:1788970051.797360:0:3285:0:(import.c:666:import_select_connection()) MGC192.168.202.109@tcp: import ffff9778652a2000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970051.797424:0:3285:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff977855c17c00 x1875870741512704/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970051.797469:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741512320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970051.797489:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d87485c-d221-41b3-b6c0-56f4dfc97796:3285:1875870741512448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970051.797610:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1d87485c-d221-41b3-b6c0-56f4dfc97796:3282:1875870741512704:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788970051.797661:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875870741512704 offset 0 length 520: 4 00000100:00100000:3.0:1788970051.797666:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d87485c-d221-41b3-b6c0-56f4dfc97796:3284:1875870741511936:0@lo:400:kworker.0 00100000:10000000:2.0:1788970051.806942:0:13145:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788970051.837512:0:13145:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3914 00000020:00000080:3.0:1788970051.837525:0:13145:0:(genops.c:885:class_export_put()) final put ffff97787f51d000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788970051.837580:0:13145:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9778601fa800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788970051.837585:0:13145:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9778601fa800 2 00000020:01000004:3.0:1788970051.837589:0:13145:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9778601fa800 from lustre-OST0000 00000020:00000080:3.0:1788970051.837615:0:13145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970051.837637:0:13145:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788970051.837641:0:13145:0:(genops.c:885:class_export_put()) final put ffff97787f51e000/lustre-OST0000_UUID 00000020:00000080:3.0:1788970051.837644:0:13145:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f51e000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788970051.837652:0:13145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788970051.837698:0:13145:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788970051.837704:0:13145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788970051.837708:0:13145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970051.837714:0:13145:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788970051.837722:0:13145:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97787f7e0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788970051.837728:0:13145:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9778500519c0) has exports, disconnecting them 00000020:00080000:3.0:1788970051.837734:0:13145:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97787f7e0000), last request at 1788969847 00000020:00000080:3.0:1788970051.837738:0:13145:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b393e 00000020:00080000:3.0:1788970051.837749:0:13145:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97787f7e0000): rc 0 00000020:00000080:3.0:1788970051.837755:0:13145:0:(genops.c:885:class_export_put()) final put ffff97787f7e0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788970051.838949:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f51d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788970051.839509:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f7e0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788970051.842087:0:13145:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788970051.842097:0:13145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970051.842101:0:13145:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788970051.842109:0:13145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788970051.842337:0:13145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970051.842349:0:13145:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788970051.842356:0:13145:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9778601fa800 1 00000020:00000080:0.0:1788970051.842366:0:13145:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b38ce 00000020:00000080:0.0:1788970051.842376:0:13145:0:(genops.c:885:class_export_put()) final put ffff97787a5ba000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788970051.842382:0:13145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788970051.842388:0:13145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970051.842392:0:13145:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788970051.842396:0:13145:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9778650e99c0) has no exports 00000020:00000080:1.0:1788970051.842916:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f7e5000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788970051.842927:0:36:0:(genops.c:885:class_export_put()) final put ffff97784c0a7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788970051.842930:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97784c0a7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788970051.842937:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788970051.843001:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a5ba000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788970051.869479:0:13145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970051.869494:0:13145:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788970051.869501:0:13145:0:(genops.c:885:class_export_put()) final put ffff9778601f9000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788970051.869506:0:13145:0:(genops.c:844:class_export_destroy()) destroying export ffff9778601f9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788970051.869516:0:13145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788970051.869663:0:13145:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9778601fc000 00000020:02000400:0.0:1788970051.869712:0:13145:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788970052.676889:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970053.700913:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970054.736928:0:13147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788970055.037044:0:13297:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788970055.055959:0:13297:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788970055.056031:0:13297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.056048:0:13297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.056056:0:13297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.056077:0:13297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.056098:0:13297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788970055.056104:0:13297:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788970055.056125:0:13297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788970055.056137:0:13297:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778812e0780 x1875870741512192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970066 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970055.056163:0:13297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788970055.056169:0:13297:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788970055.056175:0:13297:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788970055.056180:0:13297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788970055.056183:0:13297:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778812e0780 x1875870741512192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970066 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970055.056191:0:13297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788970055.056194:0:13297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:1.0:1788970055.056632:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970055.056641:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970055.056649:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031600 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788970055.056653:0:13146:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970055.056663:0:13146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970055.056670:0:13146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970055.056677:0:13146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788970055.056680:0:13146:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788970055.056682:0:13146:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788970055.056695:0:13146:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778652a2000 00010000:00010000:1.0:1788970055.056707:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970055.056714:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977840031600/0x5d0de860b05b3ae9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b3af0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970055.056728:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970055.056729:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970055.056731:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970055.056869:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741512192:0@lo:38:kworker.0 00010000:00010000:2.0:1788970055.058405:0:13297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.058563:0:13297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.058571:0:13297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.058784:0:13297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.058929:0:13297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970055.058939:0:13297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.058947:0:13297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.058954:0:13297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.058962:0:13297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970055.059218:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970055.059227:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970055.059235:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977841545600 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970055.059239:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970055.059249:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970055.059257:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970055.059263:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970055.059272:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788970055.059283:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778652a2000 00010000:00010000:3.0:1788970055.059287:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970055.059294:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977841545600/0x5d0de860b05b3af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b3afe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970055.059318:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970055.059322:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970055.059328:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92800 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970055.059331:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970055.059337:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970055.059344:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970055.059349:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788970055.059351:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788970055.059354:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778652a2000 00010000:00010000:3.0:1788970055.059357:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970055.059363:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970055.059365:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970055.059366:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970055.059593:0:13297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788970055.059599:0:13297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977880f92800/0x5d0de860b05b3d20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b3d27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970055.059613:0:13297:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788970055.059617:0:13297:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788970055.059619:0:13297:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788970055.059645:0:13297:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788970055.059649:0:13297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788970055.059655:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970055.059660:0:13297:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788970055.059664:0:13297:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9778650eb380) has no exports 00000020:00080000:2.0:1788970055.059686:0:13297:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9778650eb380) has no exports 00010000:00010000:1.0:1788970055.061573:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788970055.063234:0:13297:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97787f4eb480 - data ffff97787fc20288/ffff97787fa3e400 00000020:01000000:2.0:1788970055.063745:0:13297:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977878e73c00 - data ffff97785c79f6c0/ffff97787dcc3c00 00100000:10000000:2.0:1788970055.077352:0:13297:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788970055.094145:0:13297:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b39df 00000020:00000080:2.0:1788970055.094155:0:13297:0:(genops.c:885:class_export_put()) final put ffff977878837000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788970055.094181:0:13297:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97784c0a0000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788970055.094185:0:13297:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97784c0a0000 2 00000020:01000004:2.0:1788970055.094188:0:13297:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97784c0a0000 from lustre-OST0001 00000020:00000080:2.0:1788970055.094210:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970055.094219:0:13297:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788970055.094222:0:13297:0:(genops.c:885:class_export_put()) final put ffff977878831000/lustre-OST0001_UUID 00000020:00000080:2.0:1788970055.094224:0:13297:0:(genops.c:844:class_export_destroy()) destroying export ffff977878831000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788970055.094232:0:13297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788970055.094438:0:13297:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1d87485c-d221-41b3-b6c0-56f4dfc97796->MGS 00000020:00000080:3.0:1788970055.094530:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff977878837000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:2.0:1788970055.094568:0:13297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b38f8 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970055.094580:0:13297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b38f8 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970055.094586:0:13297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788970055.094589:0:13297:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788970055.094593:0:13297:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788970055.094607:0:13297:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778652a2000 00010000:00010000:2.0:1788970055.094610:0:13297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff4600/0x5d0de860b05b38f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b38f8 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970055.094629:0:13297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b3b44 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970055.094636:0:13297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b3b44 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970055.094640:0:13297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970055.094653:0:13297:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788970055.094655:0:13297:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788970055.094665:0:13297:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778652a2000 00010000:00010000:2.0:1788970055.094668:0:13297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff4400/0x5d0de860b05b3b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b3b44 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788970055.094686:0:13297:0:(import.c:65:import_set_state_nolock()) ffff9778652a2000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788970055.094690:0:13297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788970055.094692:0:13297:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788970055.094696:0:13297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788970055.094700:0:13297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788970055.094710:0:13297:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff977855c17c00 x1875870741512704/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788970061 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788970055.094732:0:13297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788970055.094734:0:13297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1788970055.094830:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1d87485c-d221-41b3-b6c0-56f4dfc97796:3282:1875870741512704:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1788970055.094965:0:13297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788970055.094972:0:13297:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b37d2 00000020:00000080:2.0:1788970055.094976:0:13297:0:(genops.c:885:class_export_put()) final put ffff9778508e9000/1d87485c-d221-41b3-b6c0-56f4dfc97796 00000020:01000000:2.0:1788970055.095026:0:13297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.109@tcp (flags='') 00000020:00000080:2.0:1788970055.095031:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970055.095036:0:13297:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.109@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788970055.095040:0:13297:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9778652a99c0) has no exports 10000000:01000000:0.0:1788970055.095085:0:5829:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788970055.095149:0:13297:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.202.109@tcp: client import never connected 00000100:00080000:2.0:1788970055.095152:0:13297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788970055.095154:0:13297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788970055.095156:0:13297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788970055.095158:0:13297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788970055.095305:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9778508e9000/1d87485c-d221-41b3-b6c0-56f4dfc97796 for MGC192.168.202.109@tcp 00000020:00000080:2.0:1788970055.095582:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970055.095587:0:13297:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.109@tcp (uuid 1d87485c-d221-41b3-b6c0-56f4dfc97796) 00000020:01000000:2.0:1788970055.095592:0:13297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788970055.095595:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970055.095599:0:13297:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788970055.095604:0:13297:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9778781ce800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788970055.095615:0:13297:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9778792199c0) has exports, disconnecting them 00000020:00080000:2.0:1788970055.095620:0:13297:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9778781ce800), last request at 1788969867 00000020:00000080:2.0:1788970055.095625:0:13297:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b3a09 00000020:00080000:2.0:1788970055.095634:0:13297:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9778781ce800): rc 0 00000020:00000080:2.0:1788970055.095637:0:13297:0:(genops.c:885:class_export_put()) final put ffff9778781ce800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788970055.095660:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778652a2000 for MGC192.168.202.109@tcp 00000020:00000080:3.0:1788970055.095666:0:36:0:(genops.c:885:class_export_put()) final put ffff9778652a7800/1d87485c-d221-41b3-b6c0-56f4dfc97796 00000020:00000080:3.0:1788970055.095668:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9778652a7800/1d87485c-d221-41b3-b6c0-56f4dfc97796 for MGC192.168.202.109@tcp 00000020:01000000:3.0:1788970055.095672:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.109@tcp (1d87485c-d221-41b3-b6c0-56f4dfc97796) 00000020:00000080:3.0:1788970055.098992:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9778781ce800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788970055.103215:0:13297:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788970055.103225:0:13297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970055.103230:0:13297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788970055.103237:0:13297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970055.103276:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778792c8000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788970055.104505:0:13147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788970055.105103:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788970055.105235:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1788970055.105698:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788970055.105902:0:5816:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9778734dec00:5816] 1 exiting: rc = 0 00000100:00100000:0.0:1788970055.105999:0:5815:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9778496f8a00:5815] 0 exiting: rc = 1 00000100:00100000:1.0:1788970055.106137:0:7605:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff977878a26200:7605] 2 exiting: rc = 0 00000100:00100000:3.0:1788970055.106262:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.106496:0:5818:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9778734de200:5818] 1 exiting: rc = 0 00000100:00100000:0.0:1788970055.106758:0:5817:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9778734de800:5817] 0 exiting: rc = 1 00000100:00100000:0.0:1788970055.106861:0:11142:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff977877f63800:11142] 3 exiting: rc = 0 00000100:00100000:0.0:1788970055.106933:0:5819:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff977860048000:5819] 2 exiting: rc = 0 00000100:00100000:3.0:1788970055.107043:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107050:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107056:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107062:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107067:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107072:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107077:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107082:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107087:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107093:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107098:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107105:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107111:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107117:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107123:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107129:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107149:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107157:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107164:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107169:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107174:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107179:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107185:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107189:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107194:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107200:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107204:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107209:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107214:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107220:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107224:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107229:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107235:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107241:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107246:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107251:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107255:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107261:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107266:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107271:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107276:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107280:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107285:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107290:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107300:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107307:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107312:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107317:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107323:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107328:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107333:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107346:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107351:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107356:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107361:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107365:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107370:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107388:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107394:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107398:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107403:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107408:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107414:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.107419:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788970055.108296:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970055.108308:0:13297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788970055.108313:0:13297:0:(genops.c:885:class_export_put()) final put ffff9778792ce000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788970055.108318:0:13297:0:(genops.c:844:class_export_destroy()) destroying export ffff9778792ce000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788970055.108323:0:13297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788970055.108364:0:13297:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97784c0a0000 1 00000020:00000080:3.0:1788970055.108370:0:13297:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b39ae 00000020:00000080:3.0:1788970055.108509:0:13297:0:(genops.c:885:class_export_put()) final put ffff97784c067800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788970055.108559:0:13297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788970055.108564:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970055.108569:0:13297:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788970055.108573:0:13297:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff977850050000) has no exports 00000020:00000080:0.0:1788970055.110564:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97784c067800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788970055.128777:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970055.128815:0:13297:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788970055.128820:0:13297:0:(genops.c:885:class_export_put()) final put ffff97784c0a1800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788970055.128824:0:13297:0:(genops.c:844:class_export_destroy()) destroying export ffff97784c0a1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788970055.128834:0:13297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788970055.129008:0:13297:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97784c0a3000 00000020:01000000:0.0:1788970055.129028:0:13297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788970055.129032:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970055.129037:0:13297:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788970055.129041:0:13297:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9778652fcd40) has no exports 00000020:00000080:0.0:1788970055.129065:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970055.129070:0:13297:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788970055.129073:0:13297:0:(genops.c:885:class_export_put()) final put ffff97787a5bc000/OSS_uuid 00000020:00000080:0.0:1788970055.129075:0:13297:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a5bc000/OSS_uuid for OSS 00000020:01000000:0.0:1788970055.129078:0:13297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788970055.129101:0:5828:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788970055.131635:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff97784c1fb800:6676] 0 exiting: rc = 1 00000100:00100000:3.0:1788970055.132257:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff97784c1fa400:6678] 1 exiting: rc = 0 00000100:00100000:2.0:1788970055.132505:0:8534:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff97786519fa00:8534] 3 exiting: rc = 0 00000100:00100000:2.0:1788970055.132584:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff97784c1fbe00:6679] 2 exiting: rc = 0 00000100:00100000:0.0:1788970055.132729:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132741:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132746:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132764:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132769:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132775:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132780:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132786:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132809:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132814:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132819:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132824:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132829:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132834:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132840:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132845:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132850:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132854:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132859:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132864:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132869:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132874:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132888:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132893:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132898:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132903:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132909:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132913:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132918:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132924:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132929:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132934:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132939:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132944:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132948:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132953:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132958:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132963:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132974:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132979:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132984:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132990:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.132995:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133000:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133005:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133010:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133027:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133033:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133037:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133042:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133047:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133052:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133057:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133062:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133067:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133073:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133077:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133082:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133087:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133091:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133096:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133101:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133107:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.133112:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.134121:0:11282:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff97786519e200:11282] 2 exiting: rc = 0 00000100:00100000:3.0:1788970055.134197:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff977855d95400:6680] 0 exiting: rc = 1 00000100:00100000:2.0:1788970055.134642:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff977846151e00:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1788970055.135029:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135039:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135045:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135051:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135057:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135062:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135068:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135073:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135078:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135093:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135098:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135104:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135109:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135113:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135118:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135123:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135128:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135132:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135137:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135141:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135146:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135151:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135156:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135161:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135166:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135170:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135175:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135180:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135184:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135189:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135193:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135198:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135202:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135207:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135211:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135216:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135221:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135226:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135230:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135235:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135239:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135244:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135249:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135253:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135262:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135267:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135272:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135277:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135282:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135286:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135291:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135296:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135301:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135306:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135311:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135316:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135321:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135326:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135331:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135336:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135340:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135345:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135349:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.135354:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.138059:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff97784c1fa600:6682] 0 exiting: rc = 1 00000100:00100000:3.0:1788970055.138275:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97784c1fb600:6683] 1 exiting: rc = 0 00000100:00100000:0.0:1788970055.138601:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff97786510ca00:6684] 2 exiting: rc = 0 00000100:00100000:0.0:1788970055.138662:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138670:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138676:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138682:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138687:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138693:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138700:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138705:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138713:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138718:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138724:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138731:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138736:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138742:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138761:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138766:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138772:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138778:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138783:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138860:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138866:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138872:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138911:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138918:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138924:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138931:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138938:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138944:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138950:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138955:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138960:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138966:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138971:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138977:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138983:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138989:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.138994:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139000:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139006:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139012:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139018:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139024:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139030:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139036:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139042:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139048:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139055:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139068:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139074:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139085:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139103:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139111:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139116:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139122:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139130:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139136:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139142:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139147:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139153:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139159:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139165:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139170:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139176:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.139182:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.147684:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff97786510d800:6685] 0 exiting: rc = 1 00000100:00100000:2.0:1788970055.147941:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97786510c600:6686] 1 exiting: rc = 0 00000100:00100000:0.0:1788970055.148131:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148138:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148144:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148149:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148154:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148160:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148165:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148170:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148176:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148181:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148186:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148192:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148196:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148201:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148207:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148211:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148216:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148221:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148226:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148231:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148245:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148251:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148256:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148261:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148266:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148271:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148277:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148282:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148287:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148292:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148297:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148302:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148307:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148312:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148316:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148320:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148325:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148330:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148334:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148339:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148346:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148352:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148359:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148364:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148368:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148375:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148551:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148556:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148561:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148566:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148571:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148577:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148582:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148588:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148593:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148606:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148610:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148615:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148620:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148625:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148629:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148634:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148638:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.148642:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970055.149572:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97786510c200:6687] 0 exiting: rc = 1 00000100:00100000:1.0:1788970055.150095:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff97786510d600:6688] 1 exiting: rc = 0 00000100:00100000:0.0:1788970055.150275:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150292:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150299:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150305:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150311:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150317:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150323:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150329:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150336:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150344:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150364:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150371:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150438:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150446:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150517:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150523:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150529:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150535:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150541:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150546:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150552:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150558:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150578:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150585:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150590:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150596:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150610:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150616:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150622:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150628:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150634:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150640:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150646:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150651:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150669:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150675:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150681:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150687:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150694:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150700:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150706:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150712:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150724:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150731:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150741:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150749:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150767:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150774:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150780:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150786:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150903:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150909:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150914:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150920:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150927:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150933:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150939:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150945:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150965:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150973:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150981:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.150999:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.151004:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970055.151011:0:13297:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788970055.161927:0:13297:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788970071.359301:0:13909:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788970079.359539:0:14370:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788970079.359544:0:14370:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788970079.359646:0:14370:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97787a5ba000 00000020:01000004:2.0:1788970079.359708:0:14370:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788970079.359716:0:14370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788970079.359728:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9778652f8000) 00000020:00000080:2.0:1788970079.359740:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788970079.380140:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788970079.383835:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788970079.384412:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 563: rc = 0 00100000:10000000:3.0:1788970079.384887:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788970079.384959:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 563: rc = 0 00100000:10000000:3.0:1788970079.385139:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 563: rc = 0 00100000:10000000:3.0:1788970079.385370:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 563: rc = 0 00100000:10000000:3.0:1788970079.385668:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 563: rc = 0 00100000:10000000:3.0:1788970079.385767:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 563: rc = 0 00100000:10000000:3.0:1788970079.386023:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 565: rc = 0 00100000:10000000:3.0:1788970079.390295:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 775: rc = 0 00100000:10000000:3.0:1788970079.390395:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 775: rc = 0 00100000:10000000:3.0:1788970079.393417:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 278: rc = 0 00100000:10000000:3.0:1788970079.394209:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 278: rc = 0 00100000:10000000:3.0:1788970079.394735:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 278: rc = 0 00100000:10000000:3.0:1788970079.395014:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 278: rc = 0 00100000:10000000:3.0:1788970079.395911:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 278: rc = 0 00100000:10000000:3.0:1788970079.396773:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 278: rc = 0 00100000:10000000:3.0:1788970079.397366:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 278: rc = 0 00100000:10000000:3.0:1788970079.397841:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 278: rc = 0 00100000:10000000:3.0:1788970079.398286:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 278: rc = 0 00100000:10000000:3.0:1788970079.398735:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 278: rc = 0 00100000:10000000:3.0:1788970079.399324:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 278: rc = 0 00100000:10000000:2.0:1788970079.407824:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 278: rc = 0 00100000:10000000:2.0:1788970079.413008:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 405: rc = 0 00100000:10000000:2.0:1788970079.413612:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 405: rc = 0 00100000:10000000:2.0:1788970079.413989:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 405: rc = 0 00100000:10000000:2.0:1788970079.414586:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 405: rc = 0 00100000:10000000:2.0:1788970079.414947:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 405: rc = 0 00100000:10000000:2.0:1788970079.415393:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 405: rc = 0 00100000:10000000:2.0:1788970079.416119:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 405: rc = 0 00100000:10000000:2.0:1788970079.416881:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 405: rc = 0 00100000:10000000:2.0:1788970079.417340:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 405: rc = 0 00100000:10000000:2.0:1788970079.417782:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 405: rc = 0 00100000:10000000:2.0:1788970079.418361:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 405: rc = 0 00100000:10000000:2.0:1788970079.418758:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 405: rc = 0 00100000:10000000:2.0:1788970079.419030:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 405: rc = 0 00100000:10000000:2.0:1788970079.419638:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 405: rc = 0 00100000:10000000:2.0:1788970079.419998:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 405: rc = 0 00100000:10000000:2.0:1788970079.422503:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 405: rc = 0 00100000:10000000:2.0:1788970079.422816:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 405: rc = 0 00100000:10000000:2.0:1788970079.423058:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 405: rc = 0 00100000:10000000:2.0:1788970079.423301:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 405: rc = 0 00100000:10000000:2.0:1788970079.423532:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 405: rc = 0 00100000:10000000:2.0:1788970079.423848:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 405: rc = 0 00100000:10000000:2.0:1788970079.424091:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 405: rc = 0 00100000:10000000:2.0:1788970079.424351:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 405: rc = 0 00100000:10000000:2.0:1788970079.424603:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 405: rc = 0 00100000:10000000:2.0:1788970079.424895:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 405: rc = 0 00100000:10000000:2.0:1788970079.425130:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 405: rc = 0 00100000:10000000:2.0:1788970079.425387:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 405: rc = 0 00100000:10000000:2.0:1788970079.425637:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 405: rc = 0 00100000:10000000:2.0:1788970079.428428:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 405: rc = 0 00100000:10000000:2.0:1788970079.428744:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 405: rc = 0 00100000:10000000:2.0:1788970079.429035:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 405: rc = 0 00100000:10000000:2.0:1788970079.430567:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 405: rc = 0 00100000:10000000:2.0:1788970079.431563:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 781: rc = 0 00100000:10000000:2.0:1788970079.432740:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788970079.432925:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 776: rc = 0 00100000:10000000:2.0:1788970079.434059:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788970079.434136:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 776: rc = 0 00100000:10000000:3.0:1788970079.435367:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788970079.435586:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 776: rc = 0 00100000:10000000:3.0:1788970079.436016:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788970079.436339:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 274: rc = 0 00100000:10000000:3.0:1788970079.436683:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788970079.436754:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 274: rc = 0 00100000:10000000:3.0:1788970079.436980:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788970079.437354:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 274: rc = 0 00000020:00000080:3.0:1788970079.437729:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788970079.437738:0:14370:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788970079.438352:0:14370:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b4ac5 00000020:01000004:3.0:1788970079.438364:0:14370:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788970079.438369:0:14370:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788970079.438376:0:14370:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97787a5ba000 from MGS 00000020:01000004:3.0:1788970079.438380:0:14370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788970079.438392:0:14370:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9778650e8000) 00000020:00000080:3.0:1788970079.438403:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788970079.438549:0:14370:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787a5ba000 from MGS, refs=2 00080000:01000000:3.0:1788970079.438555:0:14370:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788970079.438560:0:14370:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b4ad3 00000100:00100000:3.0:1788970079.438687:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788970079.438957:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788970079.438964:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788970079.439960:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788970079.439972:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788970079.441627:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970079.442139:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788970079.442146:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788970079.443033:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788970079.443114:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788970079.443683:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788970079.443690:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788970079.445395:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970079.445400:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970079.445402:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970079.445927:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970079.445936:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970079.445938:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970079.459713:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788970079.466600:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788970079.473926:0:14370:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788970079.473941:0:14370:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788970079.473944:0:14370:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788970079.479487:0:14379:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788970079.479737:0:14370:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788970079.479833:0:14370:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788970079.480202:0:14370:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788970079.480754:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970079.480930:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788970079.480936:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788970079.482845:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788970079.482859:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788970079.483693:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788970079.483701:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788970079.486322:0:14384:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788970079.486554:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788970079.486588:0:14370:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.109@tcp' 00000020:01000004:1.0:1788970079.486590:0:14370:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788970079.486623:0:14370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.109@tcp (typ=mgc) 00000020:00000080:1.0:1788970079.486636:0:14370:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.109@tcp (ffff9778652a99c0) 00000020:00000080:1.0:1788970079.486662:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788970079.486734:0:14370:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9778508e9000@MGC192.168.202.109@tcp: add connection 192.168.202.109@tcp at head 00010000:00010000:2.0:1788970079.497838:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.109@tcp-0 is initialized 00000040:01000000:2.0:1788970079.497849:0:14370:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788970079.506521:0:14385:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788970079.523636:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.109@tcp (uuid de37645b-91a3-4bf2-a071-03e750936262) 00000020:00000080:2.0:1788970079.523690:0:14370:0:(genops.c:1384:class_connect()) connect: client de37645b-91a3-4bf2-a071-03e750936262, cookie 0x5d0de860b05b4ae1 00000100:00080000:2.0:1788970079.523701:0:14370:0:(import.c:545:import_select_connection()) MGC192.168.202.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970079.523714:0:14370:0:(import.c:666:import_select_connection()) MGC192.168.202.109@tcp: import ffff9778508e9000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970079.523748:0:14370:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff43480 x1875870741512832/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970079.523782:0:14370:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import de37645b-91a3-4bf2-a071-03e750936262->MGS 00000020:01000004:2.0:1788970079.523831:0:14370:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788970079.523836:0:14370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788970079.523850:0:14370:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9778652fcd40) 00000020:00000080:2.0:1788970079.523862:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788970079.524499:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de37645b-91a3-4bf2-a071-03e750936262:3282:1875870741512832:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788970079.524568:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970079.524676:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741512832 00000100:00100000:1.0:1788970079.524685:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741512832 00000100:00100000:1.0:1788970079.524720:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970079.524727:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875870741512832:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788970079.524751:0:14380:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from de37645b-91a3-4bf2-a071-03e750936262@0@lo t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:1.0:1788970079.524781:0:14380:0:(genops.c:1384:class_connect()) connect: client de37645b-91a3-4bf2-a071-03e750936262, cookie 0x5d0de860b05b4aef 00000100:00080000:1.0:1788970079.524887:0:14380:0:(import.c:65:import_set_state_nolock()) ffff9778508ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970079.524929:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+5:3282:x1875870741512832:12345-0@lo:250:mount.lustre.0 Request processed in 202us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.524934:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970079.524967:0:3282:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788970079.524973:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.109@tcp: connect to target with instance 0 00000100:00080000:1.0:1788970079.524978:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788970079.524981:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788970079.524983:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778508e9000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788970079.524985:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788970079.524992:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788970079.524996:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de37645b-91a3-4bf2-a071-03e750936262:3282:1875870741512832:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788970079.537262:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970079.537461:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788970079.537467:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788970079.541295:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788970079.541308:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788970079.541861:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788970079.541868:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788970079.542475:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970079.542830:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788970079.542835:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788970079.543975:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788970079.543983:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788970079.578935:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970079.579216:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788970079.579222:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788970079.580637:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788970079.580658:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788970079.581412:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970079.581974:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788970079.581981:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788970079.582895:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788970079.582907:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788970079.583891:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970079.584189:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788970079.584195:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788970079.585229:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788970079.585238:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788970079.586204:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970079.586352:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788970079.586357:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788970079.587168:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788970079.587176:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788970079.607784:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970079.608112:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788970079.608120:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788970079.609843:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788970079.609854:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788970079.610754:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788970079.610762:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788970079.611967:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788970079.611989:0:14370:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788970079.611997:0:14370:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788970079.612141:0:14370:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970079.612246:0:14370:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788970079.612251:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970079.612257:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970079.612259:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970079.612260:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970079.612261:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970079.612262:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970079.612263:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970079.612264:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970079.612266:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970079.612267:0:14370:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970079.612270:0:14370:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788970079.612272:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970079.612273:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970079.612274:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970079.612275:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970079.612276:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970079.612277:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970079.612278:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970079.612278:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970079.612279:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970079.612280:0:14370:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970079.612305:0:14370:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788970079.612325:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741512960:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970079.612398:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970079.612571:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787a5fd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970079.612662:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741512960 00000100:00100000:0.0:1788970079.612670:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741512960 00000100:00100000:0.0:1788970079.612946:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970079.612957:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+5:14370:x1875870741512960:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788970079.612995:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788970079.612997:0:14383:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788970079.612999:0:14383:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788970079.613356:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788970079.613747:0:14383:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788970079.614894:0:14405:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788970079.614901:0:14405:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788970079.614904:0:14405:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788970079.614940:0:14405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788970079.615279:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788970079.615289:0:14383:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788970079.622630:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+5:14370:x1875870741512960:12345-0@lo:253:mount.lustre.0 Request processed in 9665us (10220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970079.622660:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970079.624560:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741512960:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970079.624578:0:14370:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788970079.624580:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970079.624582:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970079.624583:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970079.624585:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970079.624586:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970079.624587:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970079.624604:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970079.624605:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970079.624607:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970079.624608:0:14370:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788970079.624635:0:14370:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97787a5ba000 from lustre-MDT0000 10000000:01000000:2.0:1788970079.624678:0:14370:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788970079.624896:0:14370:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788970079.624901:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9778652a99c0 10000000:01000000:2.0:1788970079.624906:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970079.624915:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9778652a99c0 from 1 10000000:01000000:2.0:1788970079.624918:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788970079.624956:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.624968:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.624978:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970079.624998:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970079.625069:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.625235:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1ccb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970079.625273:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741513088 00000100:00100000:0.0:1788970079.625280:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741513088 00000100:00100000:0.0:1788970079.625359:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970079.625369:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+5:14370:x1875870741513088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970079.625384:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970079.625397:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f485e00/0x5d0de860b05b4afd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4af6 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970079.625426:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f485e00/0x5d0de860b05b4afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4af6 expref: 6 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970079.625437:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f485e00/0x5d0de860b05b4afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4af6 expref: 6 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970079.625454:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485e00, rc 0) 00000100:00100000:0.0:1788970079.625539:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+6:14370:x1875870741513088:12345-0@lo:101:mount.lustre.0 Request processed in 171us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970079.625546:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970079.625664:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970079.625676:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.625749:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970079.625818:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970079.625847:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.625997:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.626067:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741513216 00000100:00100000:1.0:1788970079.626071:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741513216 00000100:00100000:1.0:1788970079.626091:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970079.626097:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+6:14370:x1875870741513216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970079.626330:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+6:14370:x1875870741513216:12345-0@lo:501:mount.lustre.0 Request processed in 232us (481us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970079.626336:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970079.626413:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513216:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788970079.626435:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788970079.626462:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.626471:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970079.626481:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97787a5ba000 10000000:01000000:2.0:1788970079.626485:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788970079.626490:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97787a5ba000 10000000:01000000:2.0:1788970079.626492:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788970079.626495:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97787a5ba000 from 1 10000000:01000000:2.0:1788970079.626498:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788970079.626516:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.626524:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.626531:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970079.626543:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970079.626569:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.626581:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.626914:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741513344 00000100:00100000:1.0:1788970079.626920:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741513344 00000100:00100000:1.0:1788970079.626941:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970079.626948:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+6:14370:x1875870741513344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970079.626958:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970079.626971:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f92800/0x5d0de860b05b4b0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4b04 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.626990:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92800/0x5d0de860b05b4b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4b04 expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.626999:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f92800/0x5d0de860b05b4b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4b04 expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.627008:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92800, rc 0) 00000100:00100000:1.0:1788970079.627049:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+7:14370:x1875870741513344:12345-0@lo:101:mount.lustre.0 Request processed in 101us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.627055:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970079.627135:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970079.627152:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.627159:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970079.627171:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788970079.627187:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.627194:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970079.627200:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788970079.627203:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970079.627208:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97787a5ba000 10000000:01000000:2.0:1788970079.627210:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788970079.627213:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788970079.627215:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788970079.627228:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.627235:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.627242:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970079.627253:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970079.627283:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.627302:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.627355:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741513472 00000100:00100000:1.0:1788970079.627359:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741513472 00000100:00100000:1.0:1788970079.627376:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970079.627382:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+7:14370:x1875870741513472:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970079.627388:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970079.627396:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f93800/0x5d0de860b05b4b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4b12 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.627409:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f93800/0x5d0de860b05b4b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4b12 expref: 8 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.627417:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f93800/0x5d0de860b05b4b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4b12 expref: 8 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.627432:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93800, rc 0) 00000100:00100000:1.0:1788970079.627536:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+8:14370:x1875870741513472:12345-0@lo:101:mount.lustre.0 Request processed in 153us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.627542:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970079.627615:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970079.627626:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.627633:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970079.627907:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970079.627935:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.627964:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.628109:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741513600 00000100:00100000:1.0:1788970079.628114:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741513600 00000100:00100000:1.0:1788970079.628134:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970079.628141:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+8:14370:x1875870741513600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970079.628675:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+9:14370:x1875870741513600:12345-0@lo:501:mount.lustre.0 Request processed in 533us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.628834:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970079.629116:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970079.629172:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970079.629217:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.629248:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.629306:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741513728 00000100:00100000:1.0:1788970079.629312:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741513728 00000100:00100000:1.0:1788970079.629335:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970079.629342:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+9:14370:x1875870741513728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970079.630011:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+9:14370:x1875870741513728:12345-0@lo:503:mount.lustre.0 Request processed in 665us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.630020:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970079.634143:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741513728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970079.634856:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14406:1875870741513856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970079.634937:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.634985:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1cc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.635050:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741513856 00000100:00100000:1.0:1788970079.635057:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741513856 00000100:00100000:1.0:1788970079.635106:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970079.635115:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+9:14406:x1875870741513856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970079.635434:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+9:14406:x1875870741513856:12345-0@lo:502:llog_process_th.0 Request processed in 319us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.635442:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970079.635759:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff412c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14406:1875870741513856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970079.635785:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970079.635811:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970079.635819:0:14406:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788970079.635830:0:14406:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788970079.635833:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970079.635848:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9778650eb380) 00000020:00000080:3.0:1788970079.635873:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788970079.635879:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788970079.635957:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788970079.635964:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b4b27 00000020:00000080:3.0:1788970079.636241:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788970079.636247:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970079.636251:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970079.636252:0:14406:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788970079.636255:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970079.636258:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970079.636260:0:14406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788970079.636263:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970079.636271:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9778650e99c0) 00000020:00000080:3.0:1788970079.636280:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788970079.636284:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788970079.636286:0:14406:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788970079.636289:0:14406:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788970079.636295:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788970079.636343:0:14406:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787a5ba000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788970079.636356:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9778650ecd40) 00000020:00000080:3.0:1788970079.636364:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788970079.636415:0:14406:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788970079.636420:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b4b3c 00000020:00000080:3.0:1788970079.636511:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788970079.636519:0:14406:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788970079.636523:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d0de860b05b4b43 00080000:01000000:3.0:1788970079.636529:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788970079.636532:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b4b4a 00010000:00010000:2.0:1788970079.685578:0:14406:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788970079.686363:0:14406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788970079.686490:0:14406:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788970079.686888:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9778652f99c0) 00000020:00000080:2.0:1788970079.686904:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788970079.686965:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788970079.686969:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b4b58 00000020:00000080:3.0:1788970079.693628:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788970079.696258:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d0de860b05b4b5f 00000020:00000080:0.0:1788970079.696813:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788970079.696826:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970079.696831:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.696833:0:14406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788970079.696835:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788970079.696838:0:14406:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788970079.696839:0:14406:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970079.696840:0:14406:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970079.696840:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788970079.696842:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.696843:0:14406:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788970079.696844:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970079.696847:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.696848:0:14406:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788970079.696851:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788970079.696880:0:14406:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788970079.696891:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970079.696892:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.696893:0:14406:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788970079.696894:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788970079.696901:0:14406:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788970079.696904:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.696905:0:14406:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788970079.696907:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788970079.696911:0:14406:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:0.0:1788970079.696930:0:14406:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788970079.696932:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970079.696942:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97787921b380) 00000020:00000080:0.0:1788970079.696952:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788970079.696955:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788970079.696995:0:14406:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788970079.696999:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788970079.697002:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b4b6d 00010000:00080000:0.0:1788970079.697024:0:14406:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9778506c0800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788970079.697220:0:14406:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788970079.697490:0:14406:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788970079.697521:0:14406:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788970079.698963:0:14406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970079.699006:0:14406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788970079.699083:0:14406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788970079.699700:0:14410:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788970079.699705:0:14410:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788970079.700310:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788970079.700320:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788970079.700345:0:14406:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788970079.700360:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b4b74 00000100:00080000:0.0:1788970079.700369:0:14406:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970079.700378:0:14406:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9778506c0800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970079.700410:0:14406:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff977855c14f00 x1875870741513984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970079.700472:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741513984:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788970079.700517:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875870741513984 offset 0 length 520: 4 00000100:00080000:0.0:1788970079.700568:0:14406:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788970079.700611:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970079.700621:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.700623:0:14406:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788970079.700626:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788970079.700629:0:14406:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788970079.700630:0:14406:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970079.700632:0:14406:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970079.700633:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788970079.700635:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.700637:0:14406:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788970079.700639:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788970079.700643:0:14406:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788970079.700657:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.700658:0:14406:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788970079.700662:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788970079.700666:0:14406:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:0.0:1788970079.700695:0:14406:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788970079.700697:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970079.700706:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97787921cd40) 00000020:00000080:0.0:1788970079.700714:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788970079.700718:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788970079.700760:0:14406:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788970079.700764:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788970079.700767:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b4b82 00010000:00080000:0.0:1788970079.700810:0:14406:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9778792c8000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788970079.700947:0:14406:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788970079.701081:0:14406:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788970079.701101:0:14406:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788970079.701514:0:14406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970079.701558:0:14406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788970079.701626:0:14406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788970079.702469:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788970079.702473:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788970079.703189:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788970079.703202:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788970079.703237:0:14406:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788970079.703251:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b4b89 00000100:00080000:0.0:1788970079.703258:0:14406:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970079.703268:0:14406:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9778792c8000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970079.703296:0:14406:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff977855c143c0 x1875870741514112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970079.703362:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741514112:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788970079.703414:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875870741514112 offset 0 length 520: 4 00000100:00080000:0.0:1788970079.703468:0:14406:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788970079.703571:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970079.703575:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.703577:0:14406:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788970079.703579:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970079.703581:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.703582:0:14406:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788970079.703584:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788970079.703585:0:14406:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788970079.703586:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970079.703588:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.703589:0:14406:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788970079.703590:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970079.703591:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.703592:0:14406:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788970079.703594:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788970079.703619:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14406:1875870741514240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970079.703693:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970079.703720:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff977846267840 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.704016:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741514240 00000100:00100000:1.0:1788970079.704023:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741514240 00000100:00100000:1.0:1788970079.704076:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970079.704085:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+9:14406:x1875870741514240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970079.704308:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+9:14406:x1875870741514240:12345-0@lo:502:llog_process_th.0 Request processed in 224us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.704316:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970079.704345:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14406:1875870741514240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788970079.704376:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970079.704380:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970079.704382:0:14406:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788970079.704386:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788970079.704541:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788970079.704557:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788970079.704575:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.704587:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970079.704596:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97787a5ba000 from 1 10000000:01000000:3.0:1788970079.704599:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788970079.704632:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.704642:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.704664:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970079.704676:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970079.704957:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970079.705031:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970079.705079:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741514368 00000100:00100000:2.0:1788970079.705086:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741514368 00000100:00100000:2.0:1788970079.705129:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970079.705137:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+9:14370:x1875870741514368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970079.705148:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970079.705166:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4b90 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.705188:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4b90 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.705199:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4b90 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.705208:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d600, rc 0) 00000100:00100000:2.0:1788970079.705302:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+10:14370:x1875870741514368:12345-0@lo:101:mount.lustre.0 Request processed in 167us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970079.705307:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970079.705353:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970079.705362:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.705380:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970079.705941:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514496:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788970079.705976:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970079.706003:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.706010:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741514496 00000100:00100000:1.0:1788970079.706016:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741514496 00000100:00100000:1.0:1788970079.706107:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970079.706115:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+10:14370:x1875870741514496:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788970079.706131:0:14383:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788970079.706137:0:14383:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788970079.706574:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+10:14370:x1875870741514496:12345-0@lo:256:mount.lustre.0 Request processed in 458us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.706582:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970079.706588:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514496:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788970079.707175:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970079.707198:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.707210:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970079.707219:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787a5ba000 from 1 10000000:01000000:3.0:1788970079.707222:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970079.707255:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.707263:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.707272:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970079.707289:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970079.707320:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970079.707406:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970079.707556:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741514624 00000100:00100000:2.0:1788970079.707563:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741514624 00000100:00100000:2.0:1788970079.707604:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970079.707611:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+10:14370:x1875870741514624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970079.707627:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970079.707639:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4b9e expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.707669:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4b9e expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.707678:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4b9e expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.707760:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c800, rc 0) 00000100:00100000:2.0:1788970079.707898:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+11:14370:x1875870741514624:12345-0@lo:101:mount.lustre.0 Request processed in 288us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970079.707905:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970079.707983:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970079.707995:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.708003:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970079.708054:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970079.708078:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970079.708139:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.708174:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741514752 00000100:00100000:1.0:1788970079.708179:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741514752 00000100:00100000:1.0:1788970079.708246:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970079.708254:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+11:14370:x1875870741514752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970079.708542:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+11:14370:x1875870741514752:12345-0@lo:501:mount.lustre.0 Request processed in 289us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.708547:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970079.708593:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970079.708622:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970079.708669:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970079.708780:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970079.708866:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741514880 00000100:00100000:2.0:1788970079.708869:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741514880 00000100:00100000:2.0:1788970079.708883:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788970079.708887:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+11:14370:x1875870741514880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970079.709029:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+11:14370:x1875870741514880:12345-0@lo:503:mount.lustre.0 Request processed in 139us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970079.709035:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970079.709156:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741514880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970079.709555:0:14414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14414:1875870741515008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970079.709588:0:14414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970079.709618:0:14414:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970079.709688:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741515008 00000100:00100000:2.0:1788970079.709693:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741515008 00000100:00100000:2.0:1788970079.709754:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970079.709761:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+11:14414:x1875870741515008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970079.709976:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+11:14414:x1875870741515008:12345-0@lo:502:llog_process_th.0 Request processed in 215us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970079.709995:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970079.710064:0:14414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14414:1875870741515008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970079.710088:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970079.710097:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970079.710099:0:14414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788970079.710108:0:14414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787a5ba000 00000020:00000080:3.0:1788970079.710111:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788970079.710119:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970079.710126:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970079.710127:0:14414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788970079.710130:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970079.710132:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970079.710134:0:14414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788970079.710137:0:14414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787a5ba000 00000020:00000080:3.0:1788970079.710139:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788970079.710192:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970079.710196:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970079.710198:0:14414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788970079.710200:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970079.710203:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970079.710204:0:14414:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788970079.710208:0:14414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97787a5ba000 00000020:00000080:3.0:1788970079.710210:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788970079.710241:0:14414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14414:1875870741515136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970079.710270:0:14414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970079.710482:0:14414:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970079.710534:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741515136 00000100:00100000:0.0:1788970079.710546:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741515136 00000100:00100000:0.0:1788970079.710572:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788970079.710580:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+11:14414:x1875870741515136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970079.712832:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+11:14414:x1875870741515136:12345-0@lo:502:llog_process_th.0 Request processed in 2243us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970079.712845:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970079.716929:0:14414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14414:1875870741515136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970079.717006:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970079.717014:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970079.717016:0:14414:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788970079.717022:0:14414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788970079.717198:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788970079.717218:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970079.717670:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.717751:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970079.717820:0:14370:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788970079.717823:0:14370:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97787a5ba000 10000000:01000000:2.0:1788970079.717826:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97787a5ba000 10000000:01000000:2.0:1788970079.717829:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970079.717836:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97787a5ba000 from 1 10000000:01000000:2.0:1788970079.717838:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788970079.717873:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.717883:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.717894:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970079.717916:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741515264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970079.718007:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.718056:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1cc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970079.719942:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741515264 00000100:00100000:3.0:1788970079.719957:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741515264 00000100:00100000:3.0:1788970079.720026:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788970079.720037:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+11:14370:x1875870741515264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970079.720054:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970079.720075:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dce00/0x5d0de860b05b4bb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4bac expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.720112:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dce00/0x5d0de860b05b4bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4bac expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.720124:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dce00/0x5d0de860b05b4bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4bac expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970079.720133:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dce00, rc 0) 00000100:00100000:3.0:1788970079.720198:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+12:14370:x1875870741515264:12345-0@lo:101:mount.lustre.0 Request processed in 163us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970079.720205:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788970079.723861:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741515264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970079.723892:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.723911:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970079.723992:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741515392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970079.724053:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.724092:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1cc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970079.724122:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741515392 00000100:00100000:2.0:1788970079.724129:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741515392 00000100:00100000:2.0:1788970079.724173:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970079.724181:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:14370:x1875870741515392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970079.724439:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:14370:x1875870741515392:12345-0@lo:501:mount.lustre.0 Request processed in 257us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970079.724448:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970079.724488:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741515392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970079.724513:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741515520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970079.724551:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.724575:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1cc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970079.725832:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741515520 00000100:00100000:1.0:1788970079.725842:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741515520 00000100:00100000:1.0:1788970079.725889:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788970079.725898:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+12:14370:x1875870741515520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970079.726105:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+12:14370:x1875870741515520:12345-0@lo:503:mount.lustre.0 Request processed in 208us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.726114:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970079.726841:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741515520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970079.727217:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14418:1875870741515648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970079.727269:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970079.727307:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778462670c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970079.727347:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741515648 00000100:00100000:2.0:1788970079.727353:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741515648 00000100:00100000:2.0:1788970079.727390:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970079.727398:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+12:14418:x1875870741515648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970079.727627:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+12:14418:x1875870741515648:12345-0@lo:502:llog_process_th.0 Request processed in 229us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970079.727657:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970079.727842:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14418:1875870741515648:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788970079.727901:0:14418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788970079.727918:0:14418:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9778792199c0) 00000020:00000080:0.0:1788970079.727939:0:14418:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788970079.728019:0:14418:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787a5ba000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788970079.728023:0:14418:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97787a5ba000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788970079.728026:0:14418:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787a5ba000 4 00010000:00080000:0.0:1788970079.728056:0:14418:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97784c249800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788970079.735094:0:14418:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788970079.735309:0:14418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788970079.735348:0:14418:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788970079.735362:0:14418:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d0de860b05b4bc1 00000100:00080000:0.0:1788970079.735373:0:14418:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970079.735386:0:14418:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97784c249800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970079.735419:0:14418:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff977855c15680 x1875870741515776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970079.735475:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741515776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788970079.735553:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788970079.735617:0:14418:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788970079.737303:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741515776 00000100:00100000:2.0:1788970079.737317:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741515776 00000100:00100000:2.0:1788970079.737356:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970079.737364:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875870741515776:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788970079.737454:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875870741515776:12345-0@lo:38:llog_process_th.0 Request processed in 88us (1900us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788970079.737460:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970079.738863:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970079.738877:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97784c249800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970079.738883:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788970079.738887:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741515776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788970079.751058:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14418:1875870741515904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970079.751137:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.751173:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741515904 00000100:00100000:2.0:1788970079.751180:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741515904 00000100:00100000:2.0:1788970079.751216:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788970079.751224:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:14418:x1875870741515904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970079.751507:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:14418:x1875870741515904:12345-0@lo:502:llog_process_th.0 Request processed in 282us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970079.751516:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788970079.751567:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784634a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788970079.751587:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de37645b-91a3-4bf2-a071-03e750936262:14418:1875870741515904:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788970079.751612:0:14418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788970079.751756:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788970079.751777:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788970079.751822:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.751835:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788970079.751885:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788970079.751887:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970079.751888:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970079.751889:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970079.751890:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970079.751892:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970079.751893:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970079.751894:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970079.751896:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970079.751897:0:14370:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970079.751901:0:14370:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788970079.751904:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788970079.751905:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970079.751906:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970079.751907:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970079.751908:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970079.751909:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970079.751910:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970079.751911:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970079.751911:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970079.751913:0:14370:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970079.751926:0:14370:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788970079.751936:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741516032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788970079.751966:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.751986:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784634a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970079.752927:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741516032 00000100:00100000:0.0:1788970079.752935:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741516032 00000100:00100000:0.0:1788970079.753767:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970079.753779:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+12:14370:x1875870741516032:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788970079.753831:0:14380:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788970079.753843:0:14380:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788970079.792017:0:14380:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788970079.792042:0:14380:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788970079.792112:0:14404:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788970079.792118:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788970079.792143:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.792174:0:14404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4b90 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.792184:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.792238:0:14404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b4b90 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.792254:0:14404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b4b90 expref: 12 pid: 14380 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970079.792268:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875870741516160:0@lo:104: 00000100:00100000:2.0:1788970079.792335:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.792382:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784634af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970079.792710:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741516160 00000100:00100000:0.0:1788970079.792719:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741516160 00000100:00100000:0.0:1788970079.792771:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970079.792781:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:14404:x1875870741516160:12345-0@lo:104: 00010000:00010000:0.0:1788970079.792817:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970079.792869:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970079.792875:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:14404:x1875870741516160:12345-0@lo:104: Request processed in 96us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970079.792882:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788970079.792902:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970079.792908:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970079.792924:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788970079.792928:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970079.792936:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970079.792944:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970079.792949:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970079.792976:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970079.792983:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970079.793002:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970079.793010:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b4b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4b97 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970079.793027:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970079.793029:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970079.793031:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970079.793059:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741516288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970079.793087:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970079.793415:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875870741516160:0@lo:104: 00010000:00010000:2.0:1788970079.793434:0:14404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970079.793556:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741516288 00000100:00100000:1.0:1788970079.793561:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741516288 00010000:00010000:1.0:1788970079.793579:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4b90 expref: 13 pid: 14380 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970079.793609:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970079.793615:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+13:3284:x1875870741516288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970079.793626:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970079.793630:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4b90 expref: 13 pid: 14380 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793642:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b4b90 expref: 13 pid: 14380 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793665:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44d600/0x5d0de860b05b4b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b4b90 expref: 13 pid: 14380 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793686:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793694:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788970079.793707:0:14373:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001590392s 00010000:00010000:1.0:1788970079.793711:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793729:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793736:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793742:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793748:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970079.793752:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793760:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793772:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970079.793780:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970079.793853:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+12:3284:x1875870741516288:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.793860:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970079.793887:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741516288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970079.794011:0:14404:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.794019:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970079.794026:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44c000/0x5d0de860b05b4bc8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970079.803098:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+11:14370:x1875870741516032:12345-0@lo:253:mount.lustre.0 Request processed in 49312us (51120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970079.803113:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970079.803261:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:14370:1875870741516032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970079.803277:0:14370:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788970079.803280:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970079.803281:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970079.803283:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970079.803284:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970079.803286:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970079.803302:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970079.803303:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970079.803305:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970079.803307:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970079.803308:0:14370:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788970079.803323:0:14370:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788970079.808212:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970079.808377:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788970079.808662:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970079.809009:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788970079.809331:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970079.809475:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788970079.810408:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970079.810565:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788970079.811517:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788970079.811919:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788970079.812261:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788970079.812416:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788970079.838025:0:14370:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788970079.838481:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788970079.838823:0:14427:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788970079.838890:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788970079.842921:0:14426:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788970079.842941:0:14426:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1788970079.844045:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788970079.844123:0:14427:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788970079.844128:0:14427:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788970079.844309:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788970079.844504:0:14370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788970079.845051:0:14370:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788970079.845062:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788970079.845207:0:14370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970079.846630:0:14370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788970079.847601:0:14370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788970079.847638:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788970079.848412:0:14370:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788970079.850262:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788970079.856078:0:14370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788970079.883482:0:14370:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788970079.883524:0:14370:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc26c1ce3988 00100000:10000000:1.0:1788970079.883532:0:14370:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788970079.884941:0:14370:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788970079.884960:0:14370:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788970079.884977:0:14370:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788970079.885001:0:14370:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788970080.517033:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788970080.645470:0:14385:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788970080.645477:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97787a5ba000 from 6 10000000:01000000:0.0:1788970080.645483:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788970080.645532:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970080.645543:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970080.645553:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970080.645576:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741516416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970080.645654:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970080.645715:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970080.645831:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741516416 00000100:00100000:2.0:1788970080.645840:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741516416 00000100:00100000:2.0:1788970080.645897:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788970080.645907:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+11:14385:x1875870741516416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970080.645921:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970080.645936:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4bcf expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970080.645971:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4bcf expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970080.645989:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4bcf expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970080.645998:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d200, rc 0) 00000100:00100000:2.0:1788970080.646043:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+12:14385:x1875870741516416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970080.646051:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788970080.647932:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741516416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970080.647960:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970080.647972:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970080.648038:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741516544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788970080.648089:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970080.648130:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861da3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970080.648184:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741516544 00000100:00100000:0.0:1788970080.648194:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741516544 00000100:00100000:0.0:1788970080.648239:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970080.648247:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+12:14385:x1875870741516544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788970080.648266:0:14380:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788970080.648281:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788970080.648284:0:14380:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788970080.648374:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+12:14385:x1875870741516544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970080.648382:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788970080.648455:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741516544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788970080.648496:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788970080.648503:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970080.648513:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970080.774505:0:14422:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788970080.774515:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970080.775338:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788970080.775347:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788970081.541289:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970081.797063:0:14422:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788970081.797086:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970081.797133:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788970081.797141:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788970082.569304:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970083.594258:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788970084.241506:0:14671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788970084.620616:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970084.805280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970084.805288:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970084.805291:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970084.805294:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970084.805297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788970084.805301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788970084.805304:0:36:0:(import.c:65:import_set_state_nolock()) ffff97784c249800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970084.805321:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97784c249800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970084.805342:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff40f00 x1875870741516800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970084.805461:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741516672:0@lo:400:kworker.0 00000100:00100000:0.0:1788970084.805533:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970084.805617:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741516672 00000100:00100000:2.0:1788970084.805626:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741516672 00000100:00100000:0.0:1788970084.805648:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741516800:0@lo:38:kworker.0 00000100:00100000:2.0:1788970084.805677:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970084.805683:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970084.805691:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:3285:x1875870741516672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970084.805761:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:3285:x1875870741516672:12345-0@lo:400:kworker.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970084.805781:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788970084.805846:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741516800 00000100:00100000:2.0:1788970084.805850:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741516800 00000100:00100000:2.0:1788970084.805868:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970084.805873:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875870741516800:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788970084.805893:0:14390:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:2.0:1788970084.805928:0:14390:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d0de860b05b4bdd 00000004:00100000:2.0:1788970084.805941:0:14390:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788970084.806065:0:14390:0:(import.c:65:import_set_state_nolock()) ffff977852b16000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970084.806100:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875870741516800:12345-0@lo:38:kworker.0 Request processed in 226us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970084.806107:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788970084.806250:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97787ff40f00 x1875870741516800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788970084.806278:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788970084.806284:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788970084.806289:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788970084.806291:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97784c249800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788970084.806297:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741516800:0@lo:38:kworker.0 00000100:00100000:0.0:1788970084.806324:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741516672:0@lo:400:kworker.0 00010000:00010000:2.0:1788970085.645680:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970086.661235:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788970086.957283:0:14821:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc648b64f0 20000000:00000080:2.0:1788970086.957304:0:14821:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97784effe000 uarg=0000000000000000 20000000:01000000:2.0:1788970086.957343:0:14821:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788970086.957350:0:14821:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788970086.957355:0:14821:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788970086.958465:0:14822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788970086.958639:0:14821:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788970086.966383:0:14821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788970086.966417:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970086.966436:0:14821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4b9e expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970086.966443:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970086.966483:0:14821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b4b9e expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970086.966497:0:14821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b4b9e expref: 11 pid: 14380 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970086.966510:0:14821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14821:1875870741516928:0@lo:104: 00000100:00100000:1.0:1788970086.966621:0:14821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970086.966713:0:14821:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861da3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788970086.970334:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741516928 00000100:00100000:2.0:1788970086.970355:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741516928 00000100:00100000:2.0:1788970086.971525:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970086.971540:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de37645b-91a3-4bf2-a071-03e750936262+3:14821:x1875870741516928:12345-0@lo:104: 00010000:00010000:2.0:1788970086.971557:0:14372:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970086.971658:0:14372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970086.971677:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de37645b-91a3-4bf2-a071-03e750936262+3:14821:x1875870741516928:12345-0@lo:104: Request processed in 144us (5057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970086.971684:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788970086.971686:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970086.971693:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.971700:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd000 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970086.971704:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.971712:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970086.971720:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970086.971726:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970086.971762:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.971768:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788970086.971771:0:14821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14821:1875870741516928:0@lo:104: 00010000:00010000:3.0:1788970086.971803:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.971811:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4b9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4ba5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970086.971813:0:14821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.971830:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970086.971832:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970086.971839:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970086.973858:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741517056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970086.973935:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970086.973972:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741517056 00000100:00100000:3.0:1788970086.973981:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741517056 00010000:00010000:3.0:1788970086.974017:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4b9e expref: 12 pid: 14380 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970086.974055:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970086.974064:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+12:3286:x1875870741517056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970086.974079:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970086.974085:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4b9e expref: 12 pid: 14380 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974097:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b4b9e expref: 12 pid: 14380 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974113:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4ba5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b4b9e expref: 12 pid: 14380 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974129:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974138:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974153:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974160:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974173:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974197:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974204:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970086.974208:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974216:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974236:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970086.974246:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970086.974270:0:14821:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970086.974278:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970086.974288:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+11:3286:x1875870741517056:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (353us total) trans 0 rc 0/0 00010000:00010000:1.0:1788970086.974292:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f92c00/0x5d0de860b05b4be4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970086.974295:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970086.975338:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741517056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970087.691905:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788970088.453412:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788970088.453420:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787a5ba000 from 10 10000000:01000000:3.0:1788970088.453426:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970088.453467:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970088.453478:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970088.453490:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970088.453514:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741517184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970088.453600:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970088.453720:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970088.460606:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741517184 00000100:00100000:2.0:1788970088.460623:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741517184 00000100:00100000:2.0:1788970088.460694:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788970088.460704:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+11:14385:x1875870741517184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970088.460721:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970088.460740:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4beb expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970088.460768:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4beb expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970088.460778:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4beb expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970088.460806:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44ce00, rc 0) 00000100:00100000:2.0:1788970088.461422:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+12:14385:x1875870741517184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 718us (7820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970088.461430:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970088.470193:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741517184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970088.470222:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970088.470236:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970088.479547:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741517312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970088.479625:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970088.479667:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1cc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970088.479689:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741517312 00000100:00100000:2.0:1788970088.479696:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741517312 00000100:00100000:2.0:1788970088.479736:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788970088.479744:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:14385:x1875870741517312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970088.480021:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:14385:x1875870741517312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970088.480029:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788970088.481179:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741517312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970088.481229:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741517440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970088.481353:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970088.481386:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1cc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970088.481602:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741517440 00000100:00100000:0.0:1788970088.481609:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741517440 00000100:00100000:0.0:1788970088.481657:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970088.481666:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+12:14385:x1875870741517440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970088.481864:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+12:14385:x1875870741517440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970088.481872:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970088.481972:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741517440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788970088.507431:0:14886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788970088.507608:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788970088.507634:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970088.507644:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970088.507656:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970088.709204:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970089.740193:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970089.926474:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970079/real 1788970079] req@ffff977855c143c0 x1875870741514112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970089 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970089.926506:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff977855c143c0 x1875870741514112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970089 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970089.926517:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970079/real 1788970079] req@ffff977855c14f00 x1875870741513984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970089 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970089.926527:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff977855c14f00 x1875870741513984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970089 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970089.926545:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970089.926579:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788970089.926583:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741514112:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788970089.926589:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778506c0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970089.926613:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788970089.926616:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741513984:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788970089.926765:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970089.926770:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788970089.926773:0:36:0:(import.c:65:import_set_state_nolock()) ffff9778506c0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970089.926777:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 391 00000100:00080000:3.0:1788970089.926783:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788970089.926814:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9778506c0800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1788970089.926848:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778812e1a40 x1875870741517696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970089.926863:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970089.926866:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970089.926868:0:36:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970089.926871:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 391 00000100:00080000:3.0:1788970089.926873:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788970089.926878:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9778792c8000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1788970089.926891:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778812e03c0 x1875870741517824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970089.926933:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741517952:0@lo:400:kworker.0 00000100:00100000:3.0:1788970089.926996:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970089.927264:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970089.927273:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741517568:0@lo:400:kworker.0 00000100:00100000:3.0:1788970089.927302:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970089.927334:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741517568 00000100:00100000:3.0:1788970089.927341:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741517568 00000100:00100000:3.0:1788970089.927383:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970089.927392:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+12:3284:x1875870741517568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970089.927448:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+12:3284:x1875870741517568:12345-0@lo:400:kworker.0 Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970089.927455:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970089.927482:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741517696:0@lo:8:kworker.0 00000400:00000100:3.0:1788970089.927518:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875870741517696 offset 0 length 520: 4 00000100:00100000:3.0:1788970089.927531:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741517824:0@lo:8:kworker.0 00000400:00000100:3.0:1788970089.927547:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875870741517824 offset 0 length 520: 4 00000100:00100000:3.0:1788970089.927591:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741517568:0@lo:400:kworker.0 00000100:00100000:2.0:1788970089.928696:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741517952 00000100:00100000:2.0:1788970089.928704:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741517952 00000100:00100000:2.0:1788970089.928746:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970089.928755:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741517952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970089.928965:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741517952:12345-0@lo:400:kworker.0 Request processed in 211us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970089.928972:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788970089.929170:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9778812e0780 x1875870741517952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970089.929184:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741517952:0@lo:400:kworker.0 00010000:00010000:3.0:1788970090.760500:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970091.013982:0:14422:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788970091.013992:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970091.014624:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788970091.014679:0:14422:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970091.014708:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1788970091.782089:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788970092.111956:0:15071:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788970092.111960:0:15071:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788970092.112089:0:15071:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97787f5e8000 00000020:01000004:2.0:1788970092.112178:0:15071:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788970092.112402:0:15071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788970092.112416:0:15071:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9778652fb380) 00000020:00000080:2.0:1788970092.112433:0:15071:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788970092.160107:0:15071:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788970092.160390:0:15071:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788970092.161122:0:15071:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788970092.161353:0:15071:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788970092.161618:0:15071:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788970092.161984:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 473: rc = 0 00100000:10000000:3.0:1788970092.162104:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 473: rc = 0 00100000:10000000:3.0:1788970092.162195:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 473: rc = 0 00100000:10000000:2.0:1788970092.176392:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:2.0:1788970092.177914:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1788970092.178193:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:2.0:1788970092.178452:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1788970092.178736:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1788970092.179014:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00000020:00000080:2.0:1788970092.181988:0:15071:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788970092.181999:0:15071:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788970092.182011:0:15071:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d0de860b05b4c00 00000020:01000004:2.0:1788970092.182019:0:15071:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788970092.182040:0:15071:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788970092.182043:0:15071:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788970092.182049:0:15071:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788970092.182053:0:15071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788970092.182078:0:15071:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff977879a899c0) 00000020:00000080:2.0:1788970092.182089:0:15071:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788970092.188044:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970092.188447:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788970092.188454:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788970092.189418:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788970092.189427:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788970092.189927:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788970092.189934:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788970092.191195:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970092.191392:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788970092.191399:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788970092.215741:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788970092.215771:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788970092.257955:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970092.259970:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788970092.259981:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788970092.264128:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788970092.264141:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788970092.265190:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788970092.265198:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788970092.267032:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970092.267219:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788970092.267224:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788970092.270341:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788970092.270354:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788970092.343465:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970092.343690:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788970092.343698:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788970092.348041:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788970092.348062:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788970092.355214:0:15071:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788970092.355242:0:15071:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788970092.355248:0:15071:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788970092.404302:0:15071:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970092.404351:0:15071:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788970092.404356:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970092.404357:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970092.404359:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970092.404360:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970092.404361:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970092.404363:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970092.404364:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970092.404366:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970092.404367:0:15071:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970092.404371:0:15071:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788970092.404373:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970092.404374:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970092.404375:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970092.404376:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970092.404378:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970092.404379:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970092.404380:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970092.404381:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970092.404382:0:15071:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970092.404409:0:15071:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788970092.404429:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970092.404496:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970092.404568:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2ee600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970092.404651:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741518080 00000100:00100000:2.0:1788970092.404660:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741518080 00000100:00100000:2.0:1788970092.404715:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788970092.404725:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:15071:x1875870741518080:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970092.404753:0:14382:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788970092.404756:0:14382:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788970092.404760:0:14382:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788970092.492843:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+12:15071:x1875870741518080:12345-0@lo:253:mount.lustre.0 Request processed in 88109us (88335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970092.492859:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970092.493081:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788970092.493109:0:15071:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788970092.493113:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788970092.493114:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970092.493131:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970092.493132:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970092.493134:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970092.493135:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970092.493137:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970092.493139:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970092.493141:0:15071:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788970092.493163:0:15071:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97787f5e8000 from lustre-OST0000 10000000:01000000:3.0:1788970092.493189:0:15071:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788970092.493192:0:15071:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788970092.493198:0:15071:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9778652a99c0 local copy 00010000:00010000:3.0:1788970092.493209:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970092.493466:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970092.493507:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970092.493567:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.493967:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741518208 00000100:00100000:0.0:1788970092.493974:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741518208 00000100:00100000:0.0:1788970092.494021:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970092.494039:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+12:15071:x1875870741518208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970092.494235:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+12:15071:x1875870741518208:12345-0@lo:501:mount.lustre.0 Request processed in 197us (726us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788970092.494243:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788970092.494511:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518208:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788970092.494540:0:15071:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788970092.494699:0:15071:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788970092.494708:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.494719:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970092.494744:0:15071:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97787f5e8000 10000000:01000000:2.0:1788970092.494749:0:15071:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788970092.494754:0:15071:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9778652a99c0 10000000:01000000:2.0:1788970092.494757:0:15071:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788970092.494761:0:15071:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9778652a99c0 from 1 10000000:01000000:2.0:1788970092.494764:0:15071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788970092.494837:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.494846:0:15071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.494855:0:15071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970092.494872:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970092.494907:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970092.494943:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787359d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788970092.495060:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741518336 00000100:00100000:3.0:1788970092.495066:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741518336 00000100:00100000:3.0:1788970092.495171:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788970092.495180:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+12:15071:x1875870741518336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970092.495191:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970092.495202:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dd600/0x5d0de860b05b4c15 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4c0e expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.495223:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dd600/0x5d0de860b05b4c15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4c0e expref: 13 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.495233:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dd600/0x5d0de860b05b4c15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4c0e expref: 13 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.495241:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd600, rc 0) 00000100:00100000:3.0:1788970092.495281:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+13:15071:x1875870741518336:12345-0@lo:101:mount.lustre.0 Request processed in 102us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970092.495287:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788970092.495504:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970092.495517:0:15071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c15 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.495538:0:15071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4c15 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970092.495555:0:15071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788970092.495572:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c15 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.495579:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c15 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970092.495586:0:15071:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788970092.495590:0:15071:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970092.495595:0:15071:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788970092.495603:0:15071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788970092.495618:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.495626:0:15071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.495633:0:15071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970092.495645:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970092.495671:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970092.495691:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787359d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.495744:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741518464 00000100:00100000:0.0:1788970092.495748:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741518464 00000100:00100000:0.0:1788970092.495777:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788970092.495783:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+13:15071:x1875870741518464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970092.495813:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970092.495822:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f485a00/0x5d0de860b05b4c23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4c1c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.495835:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f485a00/0x5d0de860b05b4c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4c1c expref: 14 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.495842:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f485a00/0x5d0de860b05b4c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4c1c expref: 14 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.495849:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485a00, rc 0) 00000100:00100000:0.0:1788970092.495878:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741518464:12345-0@lo:101:mount.lustre.0 Request processed in 94us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.495884:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970092.496021:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970092.496043:0:15071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.496050:0:15071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970092.496782:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788970092.498413:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970092.498711:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788970092.498755:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788970092.498811:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788970092.498878:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788970092.499012:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788970092.499065:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788970092.499145:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788970092.499154:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788970092.499283:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970092.499346:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970092.499396:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787359d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.499573:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741518592 00000100:00100000:0.0:1788970092.499582:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741518592 00000100:00100000:0.0:1788970092.499636:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970092.499646:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741518592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970092.500174:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741518592:12345-0@lo:501:mount.lustre.0 Request processed in 529us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.500192:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788970092.500376:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970092.500412:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970092.500447:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970092.500472:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787359d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970092.500487:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741518720 00000100:00100000:2.0:1788970092.500491:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741518720 00000100:00100000:2.0:1788970092.500517:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970092.500524:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741518720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970092.500842:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741518720:12345-0@lo:503:mount.lustre.0 Request processed in 317us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970092.500848:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970092.500890:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788970092.501708:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970092.501777:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970092.502274:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970092.502351:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787359d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.502389:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741518848 00000100:00100000:0.0:1788970092.502396:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741518848 00000100:00100000:0.0:1788970092.502465:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788970092.502473:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741518848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970092.502695:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741518848:12345-0@lo:502:mount.lustre.0 Request processed in 223us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.502702:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788970092.502777:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970092.503051:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788970092.503283:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788970092.503323:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788970092.503372:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788970092.503410:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788970092.503448:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788970092.503495:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788970092.503548:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788970092.503580:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788970092.503621:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788970092.503656:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788970092.503702:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788970092.503739:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970092.503813:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970092.504089:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970092.504254:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741518976 00000100:00100000:2.0:1788970092.504261:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741518976 00000100:00100000:2.0:1788970092.504297:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788970092.504306:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741518976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970092.504484:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741518976:12345-0@lo:502:mount.lustre.0 Request processed in 179us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970092.504501:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970092.504597:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741518976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970092.504670:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788970092.504682:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788970092.505740:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788970092.505750:0:15086:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788970092.505757:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970092.505760:0:15086:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788970092.505769:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970092.505784:0:15086:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff977850050000) 00000020:00000080:3.0:1788970092.505830:0:15086:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788970092.505843:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788970092.505926:0:15086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787f5e8000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788970092.505936:0:15086:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788970092.505942:0:15086:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d0de860b05b4c31 00010000:00010000:3.0:1788970092.510476:0:15086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788970092.510906:0:15086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788970092.513303:0:15086:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788970092.514632:0:15086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788970092.514644:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970092.514650:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970092.514652:0:15086:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788970092.514655:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788970092.514657:0:15086:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788970092.514659:0:15086:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788970092.514660:0:15086:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788970092.514662:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788970092.514664:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970092.514666:0:15086:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788970092.514668:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970092.514671:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970092.514673:0:15086:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788970092.514675:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788970092.514678:0:15086:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788970092.514680:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970092.514682:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970092.514683:0:15086:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788970092.514686:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970092.514688:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970092.514690:0:15086:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788970092.514693:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788970092.514747:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970092.514750:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970092.514752:0:15086:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788970092.514756:0:15086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788970092.518072:0:15071:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788970092.518123:0:15071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788970092.518145:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.518159:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970092.518169:0:15071:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787f5e8000 from 1 10000000:01000000:0.0:1788970092.518172:0:15071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970092.518210:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.518218:0:15071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.518228:0:15071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970092.518254:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970092.518327:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970092.518374:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff977878952a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970092.518759:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741519104 00000100:00100000:2.0:1788970092.518768:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741519104 00000100:00100000:2.0:1788970092.520176:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788970092.520192:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+14:15071:x1875870741519104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970092.520209:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970092.520226:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4c38 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.520252:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4c38 expref: 15 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.520264:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4c38 expref: 15 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.520273:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44de00, rc 0) 00000100:00100000:2.0:1788970092.520342:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519104:12345-0@lo:101:mount.lustre.0 Request processed in 154us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970092.520349:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788970092.520546:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970092.520564:0:15071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970092.520573:0:15071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970092.521448:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788970092.523739:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970092.525449:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788970092.525507:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788970092.525584:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788970092.525594:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788970092.525714:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970092.525786:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970092.525850:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.526089:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741519232 00000100:00100000:0.0:1788970092.526171:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741519232 00000100:00100000:0.0:1788970092.526222:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788970092.526232:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970092.526455:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519232:12345-0@lo:501:mount.lustre.0 Request processed in 224us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.526463:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970092.527863:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970092.528005:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970092.528206:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970092.528245:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970092.528929:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741519360 00000100:00100000:3.0:1788970092.528938:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741519360 00000100:00100000:3.0:1788970092.528982:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970092.528991:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970092.529209:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519360:12345-0@lo:503:mount.lustre.0 Request processed in 219us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970092.529218:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788970092.529576:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788970092.530265:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788970092.530332:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970092.530387:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970092.530423:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970092.530645:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741519488 00000100:00100000:2.0:1788970092.530652:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741519488 00000100:00100000:2.0:1788970092.530745:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788970092.530754:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970092.530952:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519488:12345-0@lo:502:mount.lustre.0 Request processed in 199us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970092.530959:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788970092.531047:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970092.531273:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788970092.531317:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788970092.531380:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788970092.531415:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788970092.531446:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788970092.531490:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788970092.531521:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788970092.531564:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788970092.531589:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970092.531624:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970092.536676:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741519616 00000100:00100000:3.0:1788970092.536691:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741519616 00000100:00100000:2.0:1788970092.536760:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970092.536786:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970092.537260:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519616:12345-0@lo:502:mount.lustre.0 Request processed in 476us (5633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970092.537270:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788970092.537390:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.537418:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970092.537610:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788970092.537627:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788970092.538939:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970092.538951:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970092.538953:0:15090:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788970092.538960:0:15090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787f5e8000 00000020:00000080:0.0:1788970092.538962:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970092.538968:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970092.538970:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970092.538972:0:15090:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788970092.538974:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970092.538976:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970092.538977:0:15090:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788970092.538980:0:15090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787f5e8000 00000020:00000080:0.0:1788970092.538982:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970092.541219:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970092.541232:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970092.541234:0:15090:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788970092.541237:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970092.541247:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970092.541249:0:15090:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788970092.541253:0:15090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97787f5e8000 00000020:00000080:0.0:1788970092.541256:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970092.541372:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970092.541375:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970092.541376:0:15090:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788970092.541379:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788970092.541490:0:15071:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788970092.541514:0:15071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970092.541545:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.541558:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970092.541605:0:15071:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788970092.541608:0:15071:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97787f5e8000 10000000:01000000:0.0:1788970092.541611:0:15071:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97787f5e8000 10000000:01000000:0.0:1788970092.541615:0:15071:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970092.541621:0:15071:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97787f5e8000 from 1 10000000:01000000:0.0:1788970092.541623:0:15071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788970092.541657:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.541665:0:15071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.541675:0:15071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970092.541700:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970092.541773:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970092.541836:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741519744 00000100:00100000:0.0:1788970092.541844:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741519744 00000100:00100000:0.0:1788970092.541878:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788970092.541887:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741519744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970092.541899:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970092.541910:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f484600/0x5d0de860b05b4c4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4c46 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.541944:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f484600/0x5d0de860b05b4c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4c46 expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.541956:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f484600/0x5d0de860b05b4c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4c46 expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.541965:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484600, rc 0) 00000100:00100000:0.0:1788970092.541996:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741519744:12345-0@lo:101:mount.lustre.0 Request processed in 110us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.542003:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788970092.542180:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778491809c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.542202:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970092.542217:0:15071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.542226:0:15071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970092.542764:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788970092.545422:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970092.547906:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788970092.548234:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788970092.548266:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788970092.548309:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788970092.548341:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788970092.548384:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788970092.548416:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788970092.548446:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788970092.548491:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788970092.550243:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788970092.550340:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788970092.550409:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788970092.550446:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788970092.550481:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788970092.550566:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788970092.550608:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788970092.550640:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788970092.551643:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788970092.551775:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788970092.551835:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788970092.551882:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788970092.551931:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788970092.551967:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788970092.552019:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788970092.554011:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788970092.554535:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788970092.554638:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788970092.555028:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788970092.555281:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788970092.555291:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788970092.555389:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970092.555463:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970092.555505:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff977842b9c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970092.556055:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741519872 00000100:00100000:3.0:1788970092.556064:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741519872 00000100:00100000:3.0:1788970092.556238:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788970092.556249:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741519872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970092.556475:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741519872:12345-0@lo:501:mount.lustre.0 Request processed in 228us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970092.556482:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788970092.556596:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741519872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970092.556631:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741520000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970092.556668:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970092.557046:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff977842b9c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970092.557288:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741520000 00000100:00100000:3.0:1788970092.557294:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741520000 00000100:00100000:3.0:1788970092.557361:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788970092.557368:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741520000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970092.557519:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741520000:12345-0@lo:503:mount.lustre.0 Request processed in 151us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970092.557537:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788970092.559346:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741520000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788970092.560621:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788970092.560729:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741520128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970092.560815:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970092.560850:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741520128 00000100:00100000:0.0:1788970092.560858:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741520128 00000100:00100000:0.0:1788970092.560895:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788970092.560903:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741520128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970092.561891:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741520128:12345-0@lo:502:mount.lustre.0 Request processed in 985us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.561902:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788970092.564273:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff977842b9c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.564311:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741520128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970092.564630:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788970092.564696:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788970092.564734:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788970092.564785:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788970092.564854:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788970092.564917:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788970092.564957:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788970092.565002:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788970092.565062:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788970092.565878:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788970092.567386:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788970092.567488:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788970092.567540:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788970092.567577:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788970092.567646:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788970092.567682:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788970092.567718:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788970092.567765:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788970092.567818:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788970092.567853:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788970092.567900:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788970092.568272:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788970092.568311:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788970092.568360:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788970092.568397:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788970092.568431:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788970092.568478:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788970092.568516:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788970092.568572:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788970092.568619:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788970092.568684:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788970092.568723:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788970092.568756:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788970092.571260:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788970092.571359:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788970092.571414:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788970092.571451:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788970092.571481:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788970092.571524:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788970092.571570:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788970092.571624:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741520256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970092.572804:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970092.572858:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741520256 00000100:00100000:0.0:1788970092.572866:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741520256 00000100:00100000:0.0:1788970092.573488:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788970092.573502:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741520256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970092.574244:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741520256:12345-0@lo:502:mount.lustre.0 Request processed in 743us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.574254:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788970092.574310:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff977842b9c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.574332:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741520256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970092.574433:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788970092.574447:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788970092.579008:0:15095:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788970092.579024:0:15095:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff977879a88000) 00000020:00000080:2.0:1788970092.579045:0:15095:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788970092.579114:0:15095:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787f5e8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788970092.579118:0:15095:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97787f5e8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788970092.579121:0:15095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787f5e8000 3 00010000:00080000:2.0:1788970092.579149:0:15095:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97787f5ef800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788970092.582885:0:15095:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788970092.587004:0:15095:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788970092.587057:0:15095:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788970092.587070:0:15095:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d0de860b05b4c5b 00000100:00080000:0.0:1788970092.587082:0:15095:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970092.587170:0:15095:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97787f5ef800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970092.587216:0:15095:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff977855c17c00 x1875870741520384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970092.587245:0:15095:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788970092.587274:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970092.587278:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970092.587281:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970092.587283:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788970092.587334:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741520512:0@lo:400:kworker.0 00000100:00100000:0.0:1788970092.587398:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970092.587850:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741520384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788970092.587885:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970092.588173:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741520512 00000100:00100000:0.0:1788970092.588181:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741520512 00000100:00100000:0.0:1788970092.588219:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741520384 00000100:00100000:0.0:1788970092.588223:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741520384 00000100:00100000:0.0:1788970092.588238:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970092.588245:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741520512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970092.588307:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741520512:12345-0@lo:400:kworker.0 Request processed in 62us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.588315:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970092.588331:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970092.588335:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875870741520384:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788970092.588355:0:14390:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:0.0:1788970092.588386:0:14390:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d0de860b05b4c62 00000004:00100000:0.0:1788970092.588400:0:14390:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788970092.588427:0:14390:0:(import.c:65:import_set_state_nolock()) ffff97787a256800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970092.588467:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875870741520384:12345-0@lo:38:llog_process_th.0 Request processed in 130us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.588474:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788970092.588512:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff977855c17c00 x1875870741520384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970092.588523:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970092.588544:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788970092.588551:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788970092.588555:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788970092.588567:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787f5ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788970092.588573:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741520384:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788970092.588767:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff977855c14b40 x1875870741520512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970092.588778:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741520512:0@lo:400:kworker.0 00000040:00080000:0.0:1788970092.588895:0:15095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788970092.589755:0:15071:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788970092.589819:0:15071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788970092.589837:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970092.589848:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788970092.589891:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788970092.589893:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788970092.589895:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970092.589896:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970092.589897:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970092.589898:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970092.589900:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970092.589901:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970092.589903:0:15071:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970092.589906:0:15071:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788970092.589908:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788970092.589910:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788970092.589911:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970092.589917:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970092.589918:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970092.589919:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970092.589920:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970092.589921:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970092.589922:0:15071:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970092.589942:0:15071:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788970092.589959:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff43840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741520640:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788970092.590010:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970092.590047:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70480 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.590174:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741520640 00000100:00100000:0.0:1788970092.590181:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741520640 00000100:00100000:0.0:1788970092.590229:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788970092.590237:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+16:15071:x1875870741520640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788970092.590273:0:14382:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788970092.590288:0:14382:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788970092.636146:0:14382:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788970092.636169:0:14382:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788970092.636246:0:14404:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788970092.636266:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788970092.636293:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970092.636316:0:14404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4bcf expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970092.636325:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970092.636368:0:14404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b4bcf expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970092.636385:0:14404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b4bcf expref: 16 pid: 14383 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970092.636401:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c1a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875870741520768:0@lo:104: 00000100:00100000:1.0:1788970092.636472:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970092.636536:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784500ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970092.636571:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741520768 00000100:00100000:0.0:1788970092.636579:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741520768 00000100:00100000:0.0:1788970092.636631:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970092.636640:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:14404:x1875870741520768:12345-0@lo:104: 00010000:00010000:0.0:1788970092.636652:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.636712:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970092.636719:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:14404:x1875870741520768:12345-0@lo:104: Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970092.636726:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788970092.636747:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970092.636754:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.636761:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485800 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788970092.636765:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.636783:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970092.636830:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970092.636837:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970092.636867:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.636873:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970092.636892:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.636898:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f485800/0x5d0de860b05b4bcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4bd6 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.636912:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970092.637095:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c1a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875870741520768:0@lo:104: 00010000:00010000:3.0:1788970092.637115:0:14404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970092.637164:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970092.637166:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970092.637178:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741520896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970092.637207:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970092.637318:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741520896 00000100:00100000:3.0:1788970092.637323:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741520896 00010000:00010000:3.0:1788970092.637349:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4bcf expref: 17 pid: 14383 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970092.637370:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970092.637376:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de37645b-91a3-4bf2-a071-03e750936262+17:3286:x1875870741520896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970092.637385:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970092.637389:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4bcf expref: 17 pid: 14383 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637400:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b4bcf expref: 17 pid: 14383 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637411:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4bd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b4bcf expref: 17 pid: 14383 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637423:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637431:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788970092.637443:0:14375:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001590392s 00010000:00010000:3.0:1788970092.637447:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637455:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637471:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637478:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637483:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970092.637487:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637494:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637515:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970092.637533:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970092.637603:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de37645b-91a3-4bf2-a071-03e750936262+16:3286:x1875870741520896:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970092.637611:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788970092.637619:0:14404:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970092.637626:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970092.637632:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f92e00/0x5d0de860b05b4c69 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970092.640712:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741520896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970092.648845:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+15:15071:x1875870741520640:12345-0@lo:253:mount.lustre.0 Request processed in 58600us (58826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970092.648865:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788970092.648995:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff43840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15071:1875870741520640:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970092.649010:0:15071:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788970092.649013:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970092.649014:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788970092.649016:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970092.649017:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970092.649018:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970092.649020:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970092.649021:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970092.649023:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970092.649024:0:15071:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788970092.649051:0:15071:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788970092.672333:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788970092.672575:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788970092.672702:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788970092.672844:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788970092.672953:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788970092.673135:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788970092.674711:0:15071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788970092.742540:0:15071:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788970092.742551:0:15071:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788970092.742581:0:15071:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788970092.742646:0:15071:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788970092.742884:0:15071:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788970092.742966:0:15071:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788970092.807691:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970093.828967:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788970094.021870:0:14385:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788970094.021878:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97787a5ba000 from 7 10000000:01000000:1.0:1788970094.021883:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970094.021933:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970094.021957:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970094.021970:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970094.021995:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741521024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970094.022064:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970094.022127:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2eee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970094.022257:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741521024 00000100:00100000:0.0:1788970094.022266:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741521024 00000100:00100000:0.0:1788970094.022320:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788970094.022329:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+15:14385:x1875870741521024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970094.022342:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970094.022356:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4c70 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970094.022380:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4c70 expref: 16 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970094.022404:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4c70 expref: 16 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970094.022412:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484400, rc 0) 00000100:00100000:0.0:1788970094.022467:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+16:14385:x1875870741521024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970094.022474:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788970094.022681:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741521024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970094.022696:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970094.022705:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970094.022755:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741521152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788970094.022809:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970094.022829:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff977843022a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970094.022879:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741521152 00000100:00100000:1.0:1788970094.022883:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741521152 00000100:00100000:1.0:1788970094.022914:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788970094.022921:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:14385:x1875870741521152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788970094.022934:0:14383:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788970094.022948:0:14383:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788970094.022951:0:14383:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788970094.023015:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:14385:x1875870741521152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970094.023021:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788970094.023178:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741521152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788970094.023230:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970094.023237:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970094.023246:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970094.856477:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970095.879752:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970096.905244:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788970097.606524:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970097.606531:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970097.606534:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970097.606537:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970097.606587:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741521536:0@lo:400:kworker.0 00000100:00100000:1.0:1788970097.606659:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970097.606735:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741521536 00000100:00100000:1.0:1788970097.606744:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741521536 00000100:00100000:1.0:1788970097.606825:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970097.606835:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741521536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970097.606889:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741521536:12345-0@lo:400:kworker.0 Request processed in 55us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970097.606896:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788970097.606938:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778650c3c00 x1875870741521536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970097.606952:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741521536:0@lo:400:kworker.0 00000100:00100000:0.0:1788970097.607060:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741521408:0@lo:400:kworker.0 00000100:00100000:0.0:1788970097.607090:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970097.607117:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970097.607123:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741521280:0@lo:400:kworker.0 00000100:00100000:0.0:1788970097.607153:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788970097.607193:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970097.607256:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741521408 00000100:00100000:1.0:1788970097.607261:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741521408 00000100:00100000:1.0:1788970097.607292:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970097.607300:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741521408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970097.607339:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741521408:12345-0@lo:400:kworker.0 Request processed in 39us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970097.607345:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970097.607362:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741521280 00000100:00100000:1.0:1788970097.607366:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741521280 00000100:00100000:1.0:1788970097.607391:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788970097.607397:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:3284:x1875870741521280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970097.607426:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:3284:x1875870741521280:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970097.607432:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788970097.607467:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741521280:0@lo:400:kworker.0 00010000:00080000:1.0:1788970097.607509:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778650c2940 x1875870741521408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970097.607519:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741521408:0@lo:400:kworker.0 00010000:00010000:3.0:1788970097.928626:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970098.951263:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788970099.087246:0:15439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788970099.973297:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970100.997130:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970101.254101:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788970102.021301:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788970102.732953:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970102.732960:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970102.732963:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970102.732966:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788970102.733011:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741521664:0@lo:400:kworker.0 00000100:00100000:3.0:1788970102.733078:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970102.733142:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741521792:0@lo:400:kworker.0 00000100:00100000:3.0:1788970102.733169:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970102.733188:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970102.733193:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741521920:0@lo:400:kworker.0 00000100:00100000:3.0:1788970102.733215:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970102.733246:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741521664 00000100:00100000:3.0:1788970102.733265:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741521664 00000100:00100000:3.0:1788970102.733311:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788970102.733319:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+16:3286:x1875870741521664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970102.733363:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+16:3286:x1875870741521664:12345-0@lo:400:kworker.0 Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970102.733369:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788970102.733400:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741521792 00000100:00100000:3.0:1788970102.733404:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741521792 00000100:00100000:3.0:1788970102.733423:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741521920 00000100:00100000:3.0:1788970102.733425:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741521920 00000100:00100000:3.0:1788970102.733462:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970102.733467:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741521792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970102.733497:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741521792:12345-0@lo:400:kworker.0 Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970102.733502:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970102.733512:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970102.733517:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741521920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970102.733536:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741521920:12345-0@lo:400:kworker.0 Request processed in 20us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970102.733541:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788970102.733577:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788970102.733611:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778812e3840 x1875870741521920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970102.733625:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741521920:0@lo:400:kworker.0 00010000:00080000:3.0:1788970102.733636:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778812e3480 x1875870741521792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970102.733655:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741521792:0@lo:400:kworker.0 00000100:00100000:3.0:1788970102.733682:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741521664:0@lo:400:kworker.0 00010000:00010000:2.0:1788970103.045391:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.069006:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970104.839519:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970089/real 1788970089] req@ffff9778812e1a40 x1875870741517696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970104.839564:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9778812e1a40 x1875870741517696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970104.839575:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970089/real 1788970089] req@ffff9778812e03c0 x1875870741517824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970104.839587:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9778812e03c0 x1875870741517824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788970104.839605:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778506c0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970104.847625:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788970104.847638:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741517696:0@lo:8:kworker.0 00000100:00080000:0.0:1788970104.847650:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970104.847660:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788970104.847663:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741517824:0@lo:8:kworker.0 00000100:00080000:2.0:1788970104.847826:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970104.847831:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788970104.847834:0:36:0:(import.c:65:import_set_state_nolock()) ffff9778506c0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970104.847839:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 401 00000100:00080000:2.0:1788970104.847846:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788970104.847857:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9778506c0800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970104.847882:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff430c0 x1875870741522176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970104.847895:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970104.847898:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788970104.847899:0:36:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970104.847902:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 401 00000100:00080000:2.0:1788970104.847904:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788970104.847909:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9778792c8000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970104.847933:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff42940 x1875870741522304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970104.847999:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741522432:0@lo:400:kworker.0 00000100:00100000:2.0:1788970104.848080:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970104.848133:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970104.848139:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741522048:0@lo:400:kworker.0 00000100:00100000:2.0:1788970104.848183:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970104.848217:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741522560:0@lo:400:kworker.0 00000100:00100000:2.0:1788970104.848244:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970104.848277:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741522432 00000100:00100000:2.0:1788970104.848285:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741522432 00000100:00100000:2.0:1788970104.848328:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741522560 00000100:00100000:2.0:1788970104.848332:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741522560 00000100:00100000:2.0:1788970104.848359:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970104.848367:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741522432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970104.848426:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741522432:12345-0@lo:400:kworker.0 Request processed in 59us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970104.848432:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970104.848448:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970104.848454:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741522560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970104.848485:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741522560:12345-0@lo:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970104.848490:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970104.848509:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741522048 00000100:00100000:2.0:1788970104.848513:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741522048 00000100:00100000:2.0:1788970104.848537:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788970104.848543:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977846209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+16:3286:x1875870741522048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970104.848570:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977846209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+16:3286:x1875870741522048:12345-0@lo:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970104.848575:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788970104.848603:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788970104.848629:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787ff43840 x1875870741522560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970104.848652:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741522560:0@lo:400:kworker.0 00000100:00100000:2.0:1788970104.848679:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741522048:0@lo:400:kworker.0 00010000:00080000:2.0:1788970104.848688:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787ff42d00 x1875870741522432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970104.848695:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741522432:0@lo:400:kworker.0 00000100:00100000:0.0:1788970104.848942:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741522176:0@lo:8:kworker.0 00000100:00100000:0.0:1788970104.848989:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970104.854106:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741522304:0@lo:8:kworker.0 00000100:00100000:0.0:1788970104.854172:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970104.858197:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741522176 00000100:00100000:2.0:1788970104.858212:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741522176 00000100:00100000:2.0:1788970104.858253:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741522304 00000100:00100000:2.0:1788970104.858256:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741522304 00000100:00100000:2.0:1788970104.858273:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970104.858281:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875870741522176:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788970104.858316:0:15073:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:2.0:1788970104.858346:0:15073:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b4c7e 00002000:00100000:2.0:1788970104.858360:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97787a265800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788970104.858364:0:15073:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788970104.858367:0:15073:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788970104.858703:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788970104.858729:0:15073:0:(import.c:65:import_set_state_nolock()) ffff97787a260000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970104.858828:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875870741522176:12345-0@lo:8:kworker.0 Request processed in 546us (9836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970104.858835:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970104.858854:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970104.858858:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875870741522304:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788970104.858869:0:15073:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788970104.858906:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875870741522304:12345-0@lo:8:kworker.0 Request processed in 46us (4735us total) trans 0 rc -19/-19 00010000:00080000:0.0:1788970104.859099:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787ff430c0 x1875870741522176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970104.859111:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970104.859119:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788970104.859126:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788970104.859131:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788970104.859139:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778506c0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788970104.859155:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788970104.859160:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741522176:0@lo:8:kworker.0 00000100:00080000:0.0:1788970104.859176:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970104.859180:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788970104.859182:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741522304:0@lo:8:kworker.0 00000004:00080000:0.0:1788970104.859240:0:14411:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788970104.859260:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14411:1875870741522816:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788970104.859293:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970104.859313:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970104.859329:0:15074:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788970104.859335:0:15074:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788970104.859426:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741522688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970104.859451:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970104.859509:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741522816 00000100:00100000:0.0:1788970104.859514:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741522816 00000100:00100000:0.0:1788970104.859594:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970104.859602:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14411:x1875870741522816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788970104.862037:0:15654:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788970104.862048:0:15654:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788970104.862053:0:15654:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:1.0:1788970104.862734:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741522688 00000100:00100000:1.0:1788970104.862744:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741522688 00000100:00100000:1.0:1788970104.862822:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970104.862832:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875870741522688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970104.862868:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970104.863075:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875870741522688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (3622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970104.863082:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788970104.863142:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855c14780 x1875870741522688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970104.863164:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741522688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970104.864080:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788970104.864130:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788970104.864211:0:14410:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788970104.864492:0:14410:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416827701364ns, next at 0ns, rc = 0 00002000:00010000:0.0:1788970104.882590:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.882604:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.882622:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.882634:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.882642:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.882662:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.882673:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.882680:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.882746:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788970104.887210:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.887221:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.887237:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.887241:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.887247:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.887259:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.887269:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.887282:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.888363:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970104.888373:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.888385:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970104.888390:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.888399:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.888433:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.888441:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1c3dc2/0x5d0de860b05b4c85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.889229:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970104.889331:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970104.889335:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.889345:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970104.889348:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.889366:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.889378:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.889385:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011414817/0x5d0de860b05b4c8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.889400:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970104.889401:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970104.889403:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.889762:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970104.896542:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.896554:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896570:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.896575:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.896581:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896595:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896605:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896613:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896635:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970104.896646:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970104.896652:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896665:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.896670:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896679:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896695:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896702:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f2817a5/0x5d0de860b05b4c93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.896718:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.896720:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.896722:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970104.897100:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.897106:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897115:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.897118:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.897122:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897131:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897144:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897152:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897173:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788970104.897571:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.897577:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897584:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.897587:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.897591:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897600:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897607:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897614:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897639:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788970104.897651:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970104.897655:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897662:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.897666:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897675:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897688:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897696:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fc0f47e/0x5d0de860b05b4c9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897710:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970104.897713:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897719:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.897722:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897740:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897750:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897757:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c93269aa/0x5d0de860b05b4ca1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.897769:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.897770:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.897772:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970104.898177:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.898182:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898191:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.898194:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.898198:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898207:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898215:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898228:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898241:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970104.898249:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970104.898252:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898258:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.898261:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898268:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898279:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898285:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2836134/0x5d0de860b05b4ca8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898297:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.898299:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.898300:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970104.898711:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.898723:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898730:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.898733:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.898737:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898745:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898753:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898761:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898774:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970104.898781:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970104.898785:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898811:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.898814:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898822:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898838:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898845:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f51eedad/0x5d0de860b05b4caf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.898857:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.898859:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.898861:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970104.899234:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.899240:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899248:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.899251:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.899254:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899263:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899270:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899276:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899298:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970104.899305:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970104.899308:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899314:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.899317:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899324:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899334:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899341:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed5b1725/0x5d0de860b05b4cb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.899351:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.899353:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.899354:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.901358:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970104.904728:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.904741:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.904758:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.904769:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.904776:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.908284:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.908310:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.908319:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.908347:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788970104.908921:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.908928:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.908941:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.908945:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.908951:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.908962:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.908970:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.909159:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970104.909167:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.909174:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970104.909179:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.909188:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.909204:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.909222:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003879bdcf/0x5d0de860b05b4cbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.909240:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970104.909242:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970104.909243:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.911101:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911128:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788970104.911734:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970104.911742:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911757:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788970104.911762:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970104.911768:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911782:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911813:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911819:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911835:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788970104.911849:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970104.911856:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911870:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.911875:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911882:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911899:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911905:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48493f9/0x5d0de860b05b4cc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911922:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970104.911924:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911930:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.911932:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911938:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911946:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911957:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b4ccb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.911971:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.911973:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.912250:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970104.913509:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788970104.913518:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.913533:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1788970104.913537:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970104.913543:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.913553:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.913562:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.913568:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.913592:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788970104.914137:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788970104.914149:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914157:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1788970104.914160:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970104.914164:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914174:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914183:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914190:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914198:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788970104.914577:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788970104.914584:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914591:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1788970104.914594:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970104.914598:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914606:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914623:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914629:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970104.914637:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788970104.915092:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788970104.915098:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915108:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.915112:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915121:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915136:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915144:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189921fd/0x5d0de860b05b4cd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915161:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970104.915164:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915181:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.915184:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915191:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915201:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915208:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ea6eeb/0x5d0de860b05b4cd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915221:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970104.915224:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915230:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970104.915233:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915240:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915249:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915262:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017553f8b/0x5d0de860b05b4ce0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970104.915275:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.915277:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970104.915278:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.915473:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970104.948964:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970104.948977:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.948994:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788970104.948998:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970104.949004:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.949020:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.949043:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.949052:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.949085:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970104.949098:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.949104:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.949111:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.949116:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.949124:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.949140:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.949147:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000457c733d/0x5d0de860b05b4ce7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.949163:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.949165:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.949168:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970104.950341:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970104.950349:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950362:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788970104.950370:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970104.950376:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950387:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950396:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950404:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950432:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970104.950444:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.950449:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950456:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.950460:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950469:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950482:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950499:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013bd0013/0x5d0de860b05b4cee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.950513:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.950515:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.950516:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970104.951554:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970104.951563:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951577:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788970104.951581:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970104.951587:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951597:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951606:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951614:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951631:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970104.951752:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.951765:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951773:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.951776:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951785:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951817:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951825:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056cc4d7b/0x5d0de860b05b4cf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.951841:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.951842:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.951844:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970104.952322:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970104.952328:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952337:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788970104.952340:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970104.952345:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952365:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952374:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952381:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952394:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970104.952401:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.952405:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952860:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.952863:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952871:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952884:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952890:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085ca2908/0x5d0de860b05b4cfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.952911:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.952912:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.952914:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970104.953350:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970104.953356:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953365:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788970104.953368:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970104.953372:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953381:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953388:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953394:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953405:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970104.953425:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.953429:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953445:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.953449:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953457:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953467:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953473:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba7e1479/0x5d0de860b05b4d03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.953486:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.953487:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.953488:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970104.954222:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970104.954229:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954240:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788970104.954243:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970104.954248:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954257:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954271:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954279:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954294:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970104.954303:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.954307:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954314:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.954317:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954326:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954338:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954346:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000275d0cf5/0x5d0de860b05b4d0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.954359:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.954366:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.954368:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970104.955317:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970104.955325:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955335:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788970104.955338:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970104.955343:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955353:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955360:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955367:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955383:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970104.955392:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.955396:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955402:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.955405:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955436:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955449:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955457:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb1dfbd/0x5d0de860b05b4d11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.955471:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.955473:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.955475:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970104.956626:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970104.956635:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.957130:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788970104.957134:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970104.957140:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.957153:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.957162:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.957181:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.957205:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970104.958681:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970104.958691:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.958702:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970104.958707:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.958717:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.958748:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.958757:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092426015/0x5d0de860b05b4d18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.958777:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970104.958780:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970104.958781:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970104.960219:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970104.960231:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960246:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788970104.960250:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970104.960256:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960269:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960278:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960286:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960315:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970104.960825:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.960833:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970104.960841:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970104.960842:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970104.960846:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.960848:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960855:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788970104.960857:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960859:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970104.960864:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960871:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.960873:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960880:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.960881:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ed7829b/0x5d0de860b05b4d1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960888:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.960899:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970104.960900:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970104.960902:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.960908:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.960919:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.960923:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.960930:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.960940:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.960947:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005326c570/0x5d0de860b05b4d26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.960959:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.960961:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.960962:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788970104.964097:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788970104.965743:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970104.965754:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.965771:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788970104.965783:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970104.965861:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.965876:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.965886:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.965894:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.966049:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970104.966470:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970104.966475:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.966484:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788970104.966488:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970104.966492:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.966501:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.966508:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.966522:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.966586:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788970104.967038:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970104.967045:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.967056:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788970104.967060:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970104.967065:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.967074:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.967083:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.967091:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967607:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788970104.967615:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967624:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.967628:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967638:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967663:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967671:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4d2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967689:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970104.967693:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967699:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.967702:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967710:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967719:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967726:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4d34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967737:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.967741:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967753:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.967756:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967763:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967774:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.967781:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.967783:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.967785:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970104.967929:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788970104.967934:0:15654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002251d49/0x5d0de860b05b4d3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970104.968398:0:15654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970104.968404:0:15654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.968426:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788970104.968430:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970104.968435:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.968445:0:15654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.968454:0:15654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.968461:0:15654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970104.968469:0:15654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788970104.968617:0:15654:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1788970104.968713:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14411:x1875870741522816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 109109us (109416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970104.968726:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970104.968736:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14411:1875870741522816:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788970104.968752:0:14411:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788970104.968818:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14411:1875870741522944:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788970104.968851:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970104.968890:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff977843022540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970104.968906:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741522944 00000100:00100000:0.0:1788970104.968913:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741522944 00000100:00100000:0.0:1788970104.968958:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970104.968966:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14411:x1875870741522944:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788970104.969000:0:15074:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1788970104.969128:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970104.969135:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.969144:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970104.969148:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.969157:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.969171:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.969184:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000861b9cce/0x5d0de860b05b4d42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970104.969199:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.969201:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970104.969203:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970104.970674:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970104.974126:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14411:x1875870741522944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5154us (5267us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788970104.974139:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970104.975469:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14411:1875870741522944:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788970104.975487:0:14411:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788970105.095139:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970106.129188:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970107.141184:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788970107.617902:0:15791:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788970107.617906:0:15791:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788970107.618046:0:15791:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97786df72000 00000020:01000004:3.0:1788970107.618061:0:15791:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788970107.618073:0:15791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788970107.618085:0:15791:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9778500519c0) 00000020:00000080:3.0:1788970107.618102:0:15791:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788970107.655135:0:15791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788970107.655408:0:15791:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788970107.656111:0:15791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788970107.657602:0:15791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788970107.657849:0:15791:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788970107.658341:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 211: rc = 0 00100000:10000000:3.0:1788970107.658448:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 211: rc = 0 00100000:10000000:3.0:1788970107.658543:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 211: rc = 0 00100000:10000000:3.0:1788970107.659038:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:3.0:1788970107.661538:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 644: rc = 0 00100000:10000000:3.0:1788970107.661940:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:3.0:1788970107.662192:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 644: rc = 0 00100000:10000000:3.0:1788970107.662456:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 644: rc = 0 00100000:10000000:3.0:1788970107.662705:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 644: rc = 0 00000020:00000080:3.0:1788970107.663698:0:15791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788970107.663716:0:15791:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788970107.663726:0:15791:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d0de860b05b4d50 00000020:01000004:3.0:1788970107.663734:0:15791:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788970107.663754:0:15791:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788970107.663757:0:15791:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788970107.663764:0:15791:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788970107.664474:0:15791:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788970107.664481:0:15791:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788970107.679704:0:15791:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970107.679741:0:15791:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.109@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788970107.679745:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970107.679747:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970107.679749:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970107.679750:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970107.679751:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970107.679753:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970107.679754:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970107.679756:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970107.679757:0:15791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970107.679760:0:15791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788970107.679763:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970107.679764:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970107.679765:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970107.679767:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970107.679768:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970107.679769:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970107.679770:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970107.679771:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970107.679773:0:15791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970107.679843:0:15791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788970107.679863:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523072:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970107.679934:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970107.680001:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11000 going to sleep for 11 seconds 00000100:00100000:1.0:1788970107.680230:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741523072 00000100:00100000:1.0:1788970107.680239:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741523072 00000100:00100000:1.0:1788970107.680290:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970107.680306:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784620a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:15791:x1875870741523072:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788970107.680337:0:14383:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788970107.680340:0:14383:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788970107.680344:0:14383:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788970107.696632:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784620a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+16:15791:x1875870741523072:12345-0@lo:253:mount.lustre.0 Request processed in 16319us (16689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970107.696648:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788970107.699639:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523072:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788970107.699662:0:15791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788970107.699681:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788970107.699683:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970107.699684:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970107.699686:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970107.699687:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970107.699689:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970107.699690:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970107.699692:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970107.699693:0:15791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788970107.700272:0:15791:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97786df72000 from lustre-OST0001 10000000:01000000:2.0:1788970107.700305:0:15791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788970107.700308:0:15791:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788970107.700316:0:15791:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9778652a99c0 local copy 00010000:00010000:2.0:1788970107.700327:0:15791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970107.700593:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970107.700654:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970107.700706:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778785b3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788970107.702102:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741523200 00000100:00100000:3.0:1788970107.702114:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741523200 00000100:00100000:3.0:1788970107.702180:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788970107.702191:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977846208050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+16:15791:x1875870741523200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970107.702573:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977846208050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+16:15791:x1875870741523200:12345-0@lo:501:mount.lustre.0 Request processed in 382us (1917us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788970107.702582:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788970107.703034:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523200:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788970107.703057:0:15791:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788970107.703240:0:15791:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788970107.703249:0:15791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.703267:0:15791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970107.703294:0:15791:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97786df72000 10000000:01000000:0.0:1788970107.703299:0:15791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788970107.703305:0:15791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788970107.703307:0:15791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970107.703311:0:15791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788970107.703314:0:15791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788970107.703347:0:15791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.703354:0:15791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.703363:0:15791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970107.703382:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970107.703436:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970107.703474:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970107.703563:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741523328 00000100:00100000:2.0:1788970107.703571:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741523328 00000100:00100000:2.0:1788970107.703616:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788970107.703626:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784620bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+16:15791:x1875870741523328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970107.703636:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970107.703649:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44d400/0x5d0de860b05b4d5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4d57 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.703670:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44d400/0x5d0de860b05b4d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4d57 expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.703680:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44d400/0x5d0de860b05b4d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4d57 expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.703689:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d400, rc 0) 00000100:00100000:2.0:1788970107.703727:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784620bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523328:12345-0@lo:101:mount.lustre.0 Request processed in 104us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970107.703733:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788970107.703774:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970107.703786:0:15791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.703826:0:15791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970107.705242:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788970107.706131:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970107.706402:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788970107.706456:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788970107.706491:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788970107.706541:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788970107.706577:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788970107.706609:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788970107.707213:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788970107.707227:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788970107.707315:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff43840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970107.707380:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970107.707473:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778785b3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788970107.709510:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741523456 00000100:00100000:1.0:1788970107.709524:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741523456 00000100:00100000:2.0:1788970107.709662:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788970107.709673:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784620b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970107.710482:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784620b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523456:12345-0@lo:501:mount.lustre.0 Request processed in 809us (3100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970107.710491:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788970107.710842:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff43840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970107.710920:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970107.710969:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970107.711009:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970107.711153:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741523584 00000100:00100000:3.0:1788970107.711159:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741523584 00000100:00100000:3.0:1788970107.711202:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788970107.711210:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970107.711539:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523584:12345-0@lo:503:mount.lustre.0 Request processed in 329us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970107.711547:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788970107.711865:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523584:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788970107.712684:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970107.712753:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970107.712836:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970107.713346:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741523712 00000100:00100000:3.0:1788970107.713354:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741523712 00000100:00100000:3.0:1788970107.713408:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788970107.713418:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970107.713636:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523712:12345-0@lo:502:mount.lustre.0 Request processed in 219us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970107.713644:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970107.713763:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778785b3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970107.713783:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970107.714320:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788970107.714374:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788970107.714425:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788970107.714472:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788970107.714508:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788970107.714539:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788970107.714601:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788970107.714635:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788970107.714680:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788970107.714715:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970107.714766:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970107.714829:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778785b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970107.715233:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741523840 00000100:00100000:3.0:1788970107.715240:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741523840 00000100:00100000:3.0:1788970107.715285:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788970107.715293:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970107.715499:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523840:12345-0@lo:502:mount.lustre.0 Request processed in 207us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970107.715507:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788970107.715653:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970107.715740:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788970107.715751:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788970107.718146:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788970107.718158:0:15792:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788970107.718165:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970107.718168:0:15792:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788970107.718174:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970107.718188:0:15792:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff977879218000) 00000020:00000080:0.0:1788970107.718211:0:15792:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788970107.718218:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788970107.718289:0:15792:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97786df72000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788970107.718296:0:15792:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788970107.718303:0:15792:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d0de860b05b4d6c 00010000:00010000:2.0:1788970107.723645:0:15792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788970107.724240:0:15792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788970107.728290:0:15792:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788970107.730251:0:15792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788970107.730264:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970107.730271:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970107.730273:0:15792:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788970107.730277:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970107.730281:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970107.730282:0:15792:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788970107.730285:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788970107.730287:0:15792:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788970107.730289:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970107.730291:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970107.730293:0:15792:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788970107.730295:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970107.730297:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970107.730304:0:15792:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788970107.730308:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788970107.730372:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970107.730376:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970107.730377:0:15792:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788970107.730381:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788970107.732242:0:15791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788970107.732282:0:15791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788970107.732300:0:15791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970107.732312:0:15791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970107.732321:0:15791:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97786df72000 from 1 10000000:01000000:1.0:1788970107.732324:0:15791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970107.732362:0:15791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970107.732370:0:15791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970107.732394:0:15791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970107.732421:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970107.732492:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970107.732544:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778503fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970107.732733:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741523968 00000100:00100000:0.0:1788970107.732740:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741523968 00000100:00100000:0.0:1788970107.732814:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970107.732824:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+17:15791:x1875870741523968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970107.732838:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970107.732910:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4d73 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.732936:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4d73 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.732948:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4d73 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.732957:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4c00, rc 0) 00000100:00100000:0.0:1788970107.733003:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741523968:12345-0@lo:101:mount.lustre.0 Request processed in 180us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970107.733010:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970107.733058:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741523968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970107.733074:0:15791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.733082:0:15791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970107.733579:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788970107.738422:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970107.738715:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788970107.738761:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788970107.741471:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788970107.741490:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788970107.741603:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970107.741676:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970107.741722:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970107.741836:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741524096 00000100:00100000:1.0:1788970107.741845:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741524096 00000100:00100000:1.0:1788970107.741903:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788970107.741919:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741524096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970107.742165:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741524096:12345-0@lo:501:mount.lustre.0 Request processed in 247us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970107.742174:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788970107.742342:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970107.742377:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970107.742431:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970107.742461:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778785b3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788970107.742517:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741524224 00000100:00100000:1.0:1788970107.742521:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741524224 00000100:00100000:1.0:1788970107.742556:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788970107.742564:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741524224:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970107.742723:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741524224:12345-0@lo:503:mount.lustre.0 Request processed in 159us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970107.742731:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788970107.742829:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524224:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788970107.743346:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970107.743423:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970107.743464:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970107.743485:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff97774379f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970107.743572:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741524352 00000100:00100000:1.0:1788970107.743577:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741524352 00000100:00100000:1.0:1788970107.743599:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788970107.743607:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741524352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970107.743746:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741524352:12345-0@lo:502:mount.lustre.0 Request processed in 140us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970107.743754:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788970107.744178:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970107.744430:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788970107.744479:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788970107.744528:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788970107.744564:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788970107.744595:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788970107.744651:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788970107.744699:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788970107.744733:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788970107.744774:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970107.745262:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970107.745333:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff97774379f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970107.745370:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741524480 00000100:00100000:1.0:1788970107.745376:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741524480 00000100:00100000:1.0:1788970107.745458:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788970107.745467:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741524480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970107.745671:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741524480:12345-0@lo:502:mount.lustre.0 Request processed in 205us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970107.745685:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970107.745770:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970107.745937:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788970107.745955:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788970107.747770:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970107.747781:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970107.747783:0:15796:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788970107.747821:0:15796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97786df72000 00000020:00000080:2.0:1788970107.747824:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970107.747831:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970107.747833:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970107.747835:0:15796:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788970107.747837:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970107.747840:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970107.747841:0:15796:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788970107.747844:0:15796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97786df72000 00000020:00000080:2.0:1788970107.747847:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970107.747906:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970107.747910:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970107.747911:0:15796:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788970107.747914:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970107.747916:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970107.747918:0:15796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970107.747921:0:15796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97786df72000 00000020:00000080:2.0:1788970107.747923:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970107.747959:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970107.747963:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970107.747964:0:15796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788970107.747967:0:15796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788970107.752099:0:15791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788970107.752137:0:15791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970107.752160:0:15791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.752171:0:15791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970107.752211:0:15791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788970107.752213:0:15791:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97786df72000 10000000:01000000:0.0:1788970107.752216:0:15791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97786df72000 10000000:01000000:0.0:1788970107.752219:0:15791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970107.752223:0:15791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97786df72000 from 1 10000000:01000000:0.0:1788970107.752224:0:15791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788970107.752254:0:15791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.752260:0:15791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.752268:0:15791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970107.752285:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970107.752338:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970107.752377:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970107.752497:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741524608 00000100:00100000:3.0:1788970107.752505:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741524608 00000100:00100000:3.0:1788970107.752729:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788970107.752739:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741524608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970107.752754:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970107.752765:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b4d88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4d81 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970107.752802:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b4d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4d81 expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970107.752814:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b4d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4d81 expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970107.752823:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9e00, rc 0) 00000100:00100000:3.0:1788970107.753145:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741524608:12345-0@lo:101:mount.lustre.0 Request processed in 407us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970107.753156:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788970107.753221:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970107.753237:0:15791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970107.753246:0:15791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970107.754241:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788970107.754752:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970107.755349:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788970107.755411:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788970107.755465:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788970107.755515:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788970107.755564:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788970107.755615:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788970107.755652:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788970107.755684:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788970107.755731:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788970107.755766:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788970107.755824:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788970107.755893:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788970107.755930:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788970107.755965:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788970107.756013:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788970107.756046:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788970107.756079:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788970107.756124:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788970107.756158:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788970107.756208:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788970107.756284:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788970107.756320:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788970107.756349:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788970107.756409:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788970107.756448:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788970107.756484:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788970107.756535:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788970107.756571:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788970107.756609:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788970107.756656:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788970107.756692:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788970107.756724:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788970107.756755:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788970107.756822:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788970107.756859:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788970107.756903:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788970107.756952:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788970107.757044:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788970107.757053:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788970107.757161:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970107.757223:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970107.757281:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741524736 00000100:00100000:3.0:1788970107.757288:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741524736 00000100:00100000:3.0:1788970107.757330:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788970107.757339:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741524736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970107.761518:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741524736:12345-0@lo:501:mount.lustre.0 Request processed in 4170us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970107.761535:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788970107.761606:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970107.761630:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970107.761687:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970107.761736:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970107.761765:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970107.761911:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741524864 00000100:00100000:1.0:1788970107.761919:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741524864 00000100:00100000:1.0:1788970107.761962:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788970107.761972:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741524864:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970107.762200:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741524864:12345-0@lo:503:mount.lustre.0 Request processed in 230us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970107.762207:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788970107.762548:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524864:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970107.763882:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970107.763958:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970107.764016:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970107.764049:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741524992 00000100:00100000:3.0:1788970107.764054:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741524992 00000100:00100000:3.0:1788970107.764089:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788970107.764097:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741524992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970107.764287:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741524992:12345-0@lo:502:mount.lustre.0 Request processed in 190us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970107.764295:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788970107.764343:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784eb11d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970107.764362:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741524992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970107.764579:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788970107.764622:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788970107.764651:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788970107.764691:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788970107.764722:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788970107.764762:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788970107.764818:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788970107.764851:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788970107.764894:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788970107.764924:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788970107.764953:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788970107.765021:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788970107.765057:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788970107.765092:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788970107.765140:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788970107.765176:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788970107.765211:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788970107.765258:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788970107.765291:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788970107.765323:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788970107.765368:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788970107.766070:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788970107.766110:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788970107.766166:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788970107.766203:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788970107.766239:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788970107.766288:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788970107.766341:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788970107.766378:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788970107.766506:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788970107.766549:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788970107.766586:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788970107.766622:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788970107.766673:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788970107.766710:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788970107.766759:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788970107.766816:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788970107.767189:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788970107.767247:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788970107.767284:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788970107.767332:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741525120:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970107.767409:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970107.767465:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970107.771597:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741525120 00000100:00100000:0.0:1788970107.771613:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741525120 00000100:00100000:0.0:1788970107.771677:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788970107.771687:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741525120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970107.772002:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741525120:12345-0@lo:502:mount.lustre.0 Request processed in 315us (4592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970107.772010:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788970107.772345:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741525120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970107.772480:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788970107.772495:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788970107.777538:0:15801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788970107.777568:0:15801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff977741980000) 00000020:00000080:0.0:1788970107.777591:0:15801:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788970107.777673:0:15801:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97786df72000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788970107.777677:0:15801:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97786df72000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788970107.777680:0:15801:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97786df72000 3 00010000:00080000:0.0:1788970107.777708:0:15801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff977845011800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788970107.782574:0:15801:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788970107.783206:0:15801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788970107.783246:0:15801:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788970107.783259:0:15801:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d0de860b05b4d96 00000100:00080000:0.0:1788970107.783269:0:15801:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970107.783280:0:15801:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff977845011800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970107.783314:0:15801:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff977855c152c0 x1875870741525248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970107.783347:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741525248:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788970107.783724:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788970107.783778:0:15801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788970107.784232:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741525248 00000100:00100000:2.0:1788970107.784242:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741525248 00000100:00100000:2.0:1788970107.784275:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970107.784282:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875870741525248:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788970107.784307:0:14388:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:2.0:1788970107.784339:0:14388:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d0de860b05b4d9d 00000004:00100000:2.0:1788970107.784359:0:14388:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788970107.784402:0:14388:0:(import.c:65:import_set_state_nolock()) ffff97787a262800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970107.784460:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875870741525248:12345-0@lo:38:llog_process_th.0 Request processed in 177us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970107.784468:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788970107.784509:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970107.784513:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788970107.784516:0:36:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970107.784519:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 416 00000100:00080000:2.0:1788970107.784523:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788970107.784529:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9778792c8000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970107.784543:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff40780 x1875870741525504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970107.784601:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741525504:0@lo:8:kworker.0 00000100:00100000:2.0:1788970107.784630:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788970107.784666:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff977855c152c0 x1875870741525248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970107.784675:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970107.784683:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788970107.784689:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788970107.784693:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788970107.784695:0:3282:0:(import.c:65:import_set_state_nolock()) ffff977845011800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788970107.784701:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741525248:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788970107.784725:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741525376:0@lo:400:kworker.0 00000100:00100000:2.0:1788970107.784759:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970107.784778:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970107.784784:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741525632:0@lo:400:kworker.0 00000100:00100000:2.0:1788970107.784823:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970107.784849:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741525760:0@lo:400:kworker.0 00000100:00100000:2.0:1788970107.784871:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970107.784902:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741525504 00000100:00100000:2.0:1788970107.784906:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741525504 00000100:00100000:2.0:1788970107.784921:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741525376 00000100:00100000:2.0:1788970107.784924:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741525376 00000100:00100000:2.0:1788970107.784954:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970107.784961:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741525376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970107.784997:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741525376:12345-0@lo:400:kworker.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970107.785003:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970107.785015:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970107.785018:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875870741525504:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788970107.785226:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875870741525504:12345-0@lo:8:kworker.0 Request processed in 205us (593us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788970107.785234:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970107.785252:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741525632 00000100:00100000:2.0:1788970107.785256:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741525632 00000100:00100000:2.0:1788970107.785285:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741525760 00000100:00100000:2.0:1788970107.785288:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741525760 00000100:00100000:2.0:1788970107.785302:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788970107.785308:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741525632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970107.785339:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741525632:12345-0@lo:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970107.785352:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788970107.785365:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970107.785370:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741525760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970107.785416:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741525760:12345-0@lo:400:kworker.0 Request processed in 45us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970107.785423:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788970107.785441:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970107.785445:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788970107.785464:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787ff403c0 x1875870741525632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970107.785475:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741525632:0@lo:400:kworker.0 00000100:00100000:2.0:1788970107.785485:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741525376:0@lo:400:kworker.0 00010000:00080000:2.0:1788970107.785505:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787ff41680 x1875870741525760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970107.785514:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741525760:0@lo:400:kworker.0 00000040:00080000:1.0:1788970107.787135:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1788970107.787943:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970107.787952:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970107.787966:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788970107.787970:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741525504:0@lo:8:kworker.0 00000020:01000000:3.0:1788970107.792025:0:15791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788970107.792066:0:15791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788970107.792082:0:15791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970107.792095:0:15791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788970107.792149:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788970107.792151:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970107.792153:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970107.792154:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970107.792155:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970107.792156:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970107.792158:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970107.792159:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970107.792161:0:15791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788970107.792164:0:15791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788970107.792167:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970107.792168:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970107.792169:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970107.792170:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970107.792171:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970107.792172:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970107.792173:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970107.792174:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970107.792175:0:15791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788970107.792201:0:15791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788970107.792220:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741525888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970107.792287:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970107.792332:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970107.792419:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741525888 00000100:00100000:1.0:1788970107.792427:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741525888 00000100:00100000:1.0:1788970107.792559:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788970107.792570:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:15791:x1875870741525888:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788970107.792595:0:14382:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788970107.792608:0:14382:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788970107.833135:0:14382:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788970107.833157:0:14382:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788970107.833176:0:14404:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788970107.833181:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788970107.833204:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.833225:0:14404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4c70 expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.833234:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.833272:0:14404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b4c70 expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970107.833286:0:14404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b4c70 expref: 19 pid: 14380 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970107.833300:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c152c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875870741526016:0@lo:104: 00000100:00100000:0.0:1788970107.833365:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970107.833421:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970107.833422:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741526016 00000100:00100000:3.0:1788970107.833429:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741526016 00000100:00100000:3.0:1788970107.833971:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970107.833981:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:14404:x1875870741526016:12345-0@lo:104: 00010000:00010000:3.0:1788970107.833994:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970107.834124:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788970107.834130:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:14404:x1875870741526016:12345-0@lo:104: Request processed in 151us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970107.834137:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970107.834984:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c152c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875870741526016:0@lo:104: 00010000:00010000:0.0:1788970107.835013:0:14404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835075:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970107.835082:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835091:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788970107.835095:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835104:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970107.835131:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970107.835137:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970107.835175:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835182:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970107.835206:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835214:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b4c70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4c77 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835231:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970107.835233:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970107.835234:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970107.835241:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970107.835252:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741526144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970107.835290:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970107.835331:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741526144 00000100:00100000:2.0:1788970107.835336:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741526144 00010000:00010000:2.0:1788970107.835357:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4c70 expref: 20 pid: 14380 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970107.835379:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970107.835397:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff40f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de37645b-91a3-4bf2-a071-03e750936262+20:3283:x1875870741526144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970107.835408:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970107.835419:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4c70 expref: 20 pid: 14380 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835432:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b4c70 expref: 20 pid: 14380 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835445:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f484400/0x5d0de860b05b4c77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b4c70 expref: 20 pid: 14380 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835459:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835468:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788970107.835482:0:14375:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002301766s 00010000:00010000:2.0:1788970107.835486:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835494:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835502:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835508:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835513:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970107.835518:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835535:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835557:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970107.835567:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970107.835595:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff40f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de37645b-91a3-4bf2-a071-03e750936262+19:3283:x1875870741526144:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970107.835602:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970107.835627:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741526144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970107.835942:0:14404:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970107.835952:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970107.835958:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff5000/0x5d0de860b05b4da4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970107.850704:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+18:15791:x1875870741525888:12345-0@lo:253:mount.lustre.0 Request processed in 58127us (58407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970107.850719:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788970107.851020:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de37645b-91a3-4bf2-a071-03e750936262:15791:1875870741525888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788970107.851037:0:15791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788970107.851102:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788970107.851104:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970107.851105:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970107.851107:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970107.851108:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970107.851110:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970107.851111:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970107.851113:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970107.851128:0:15791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788970107.851144:0:15791:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788970107.861333:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970107.861517:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788970107.861669:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970107.861843:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788970107.863346:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970107.863585:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788970107.866535:0:15791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788970107.986612:0:15791:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788970107.986622:0:15791:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788970107.986657:0:15791:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788970107.986737:0:15791:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788970107.986751:0:15791:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788970107.986783:0:15791:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788970108.169577:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788970108.520414:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788970108.520532:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788970109.189256:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788970109.641063:0:14385:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788970109.641072:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97787a5ba000 from 8 10000000:01000000:0.0:1788970109.641078:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788970109.641127:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970109.641139:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970109.641151:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970109.641181:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741526272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970109.641250:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970109.641299:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99840 going to sleep for 11 seconds 00000100:00100000:3.0:1788970109.641681:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741526272 00000100:00100000:3.0:1788970109.641689:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741526272 00000100:00100000:3.0:1788970109.641747:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788970109.641757:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+18:14385:x1875870741526272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970109.641771:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970109.641785:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a9400/0x5d0de860b05b4db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4dab expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970109.641835:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9400/0x5d0de860b05b4db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4dab expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970109.641845:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a9400/0x5d0de860b05b4db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4dab expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970109.641853:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9400, rc 0) 00000100:00100000:3.0:1788970109.642101:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:14385:x1875870741526272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 345us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970109.642109:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788970109.642182:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741526272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970109.642198:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970109.642207:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970109.642261:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741526400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788970109.642290:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970109.642315:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847f99840 going to sleep for 11 seconds 00000100:00100000:3.0:1788970109.642357:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741526400 00000100:00100000:3.0:1788970109.642362:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741526400 00000100:00100000:3.0:1788970109.642402:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788970109.642409:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:14385:x1875870741526400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788970109.642421:0:14382:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788970109.642735:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788970109.642739:0:14382:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788970109.643316:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:14385:x1875870741526400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 905us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970109.643335:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788970109.643465:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741526400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788970109.643661:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788970109.643669:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970109.643679:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970109.897143:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741526528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970109.897212:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970109.897296:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741526528 00000100:00100000:2.0:1788970109.897304:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741526528 00000100:00100000:2.0:1788970109.897357:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970109.897380:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741526528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970109.897433:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970109.897480:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741526528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970109.897487:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788970109.897510:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970109.897538:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788970109.897559:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741526528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788970110.215043:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970111.237383:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788970111.494012:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788970112.260978:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970112.965532:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970112.965539:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788970112.965542:0:36:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970112.965558:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9778792c8000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970112.965576:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff41a40 x1875870741526912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970112.967546:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741526656:0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.967614:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970112.967656:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741527296:0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.967682:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970112.967705:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970112.967710:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741527168:0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.969287:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970112.969354:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741526784:0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.973484:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970112.973541:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970112.973553:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741527040:0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.973585:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970112.973628:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741526912:0@lo:8:kworker.0 00000100:00100000:2.0:1788970112.973652:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970112.973916:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741526656 00000100:00100000:2.0:1788970112.973925:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741526656 00000100:00100000:2.0:1788970112.973970:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788970112.973979:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:3286:x1875870741526656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.974031:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:3286:x1875870741526656:12345-0@lo:400:kworker.0 Request processed in 53us (6416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970112.974038:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788970112.974068:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741527296 00000100:00100000:2.0:1788970112.974072:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741527296 00000100:00100000:2.0:1788970112.974100:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741527168 00000100:00100000:2.0:1788970112.974103:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741527168 00000100:00100000:2.0:1788970112.974115:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741527040 00000100:00100000:2.0:1788970112.974117:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741527040 00000100:00100000:2.0:1788970112.974130:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970112.974136:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741527296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.974171:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741527296:12345-0@lo:400:kworker.0 Request processed in 35us (6487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970112.974177:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970112.974189:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970112.974194:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741527168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.974224:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741527168:12345-0@lo:400:kworker.0 Request processed in 30us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970112.974238:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970112.974253:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970112.974258:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741527040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.974301:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741527040:12345-0@lo:400:kworker.0 Request processed in 43us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970112.974307:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788970112.974385:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787ff43840 x1875870741527040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970112.974399:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741527040:0@lo:400:kworker.0 00000100:00100000:0.0:1788970112.975889:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741526784 00000100:00100000:0.0:1788970112.975901:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741526784 00000100:00100000:0.0:1788970112.975946:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741526912 00000100:00100000:0.0:1788970112.975949:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741526912 00000100:00100000:0.0:1788970112.975968:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970112.975975:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741526784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970112.976063:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741526784:12345-0@lo:400:kworker.0 Request processed in 88us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970112.976069:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970112.976088:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970112.976092:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3282:x1875870741526912:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788970112.976309:0:15654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:0.0:1788970112.976347:0:15654:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b4db9 00002000:00100000:0.0:1788970112.976362:0:15654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9778798bf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788970112.976366:0:15654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788970112.976369:0:15654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788970112.976997:0:15654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788970112.977020:0:15654:0:(import.c:65:import_set_state_nolock()) ffff9778798b9000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1788970112.977226:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787ff41e00 x1875870741527168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970112.977241:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741527168:0@lo:400:kworker.0 00000100:00100000:2.0:1788970112.977254:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741526656:0@lo:400:kworker.0 00010000:00080000:2.0:1788970112.977265:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787ff42940 x1875870741527296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970112.977273:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741527296:0@lo:400:kworker.0 00000100:00100000:0.0:1788970112.977300:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1875870741526912:12345-0@lo:8:kworker.0 Request processed in 1206us (3646us total) trans 0 rc 0/0 00000100:00080000:2.0:1788970112.977301:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970112.977306:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970112.977307:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788970112.977328:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787ff41a40 x1875870741526912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970112.977346:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741526784:0@lo:400:kworker.0 00000100:00080000:2.0:1788970112.977351:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788970112.977359:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788970112.977364:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788970112.977366:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788970112.977400:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788970112.977405:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741526912:0@lo:8:kworker.0 00000004:00080000:1.0:1788970112.977734:0:14413:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788970112.977756:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c1680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14413:1875870741527552:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788970112.977771:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741527424:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788970112.977868:0:14412:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788970112.978282:0:14412:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424941490965ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788970112.986472:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970112.990312:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741527424 00000100:00100000:2.0:1788970112.990352:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741527424 00000100:00100000:2.0:1788970112.990426:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970112.990436:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875870741527424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970112.990492:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970112.990579:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875870741527424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970112.990586:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788970112.990608:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788970112.990646:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778650c30c0 x1875870741527424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970112.990666:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741527424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970112.995967:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970112.996082:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741527552 00000100:00100000:1.0:1788970112.996093:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741527552 00000100:00100000:1.0:1788970112.996145:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970112.996154:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14413:x1875870741527552:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788970113.007562:0:15072:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788970113.007587:0:15072:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788970113.007593:0:15072:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788970113.024270:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.024283:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.024300:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1788970113.024305:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.024310:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.024328:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.024353:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.024361:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.024407:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970113.027040:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.027054:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.027071:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1788970113.027075:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.027080:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.027102:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.027113:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.027120:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.027141:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788970113.028005:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.028013:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.028024:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1788970113.028028:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.028033:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.028043:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.028051:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.028069:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.028077:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788970113.028434:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788970113.028443:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028451:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970113.028456:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028478:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028500:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028508:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ed7829b/0x5d0de860b05b4dc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028529:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970113.028533:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028540:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970113.028550:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028558:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028569:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028577:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005326c570/0x5d0de860b05b4dc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028589:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970113.028592:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028599:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970113.028602:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028609:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028619:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028626:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b4dce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.028646:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.028648:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.028649:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970113.029381:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785095c780 going to sleep for 10 seconds 00002000:00010000:1.0:1788970113.030565:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.030576:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.030593:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1788970113.030597:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.030603:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.030617:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.030625:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.030632:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.030655:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970113.030887:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970113.030894:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.030902:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970113.030907:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.030914:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.030930:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.030937:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4dd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.047320:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.047328:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.047330:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.049037:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.049662:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.049678:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.049696:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.049700:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.049707:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.050479:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.050497:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.050506:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.050527:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970113.052222:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970113.052234:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.052265:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970113.052269:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.052280:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.052299:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.052307:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4ddc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.052343:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.052345:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.052347:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.054965:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.054978:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.054995:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.054999:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.055005:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.055020:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.055039:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.055047:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.055066:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970113.055082:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.055088:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.055431:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.055438:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.055449:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.055474:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.055483:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4de3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.055502:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.055511:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.055513:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.056049:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.056056:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.056067:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.056071:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.056076:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.056086:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.056107:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.056116:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.056134:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970113.057092:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970113.057112:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.057123:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970113.057127:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.057136:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.057162:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.057169:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b4dea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.057199:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.057201:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.057203:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.075673:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.075687:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075705:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.075709:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.075723:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075744:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075755:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075763:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075780:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970113.075807:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.075813:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075819:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.075824:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075832:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075848:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075856:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009194fffc/0x5d0de860b05b4df1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.075880:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.075882:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.075884:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.077297:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.077308:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.077322:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.077326:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.077342:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.077356:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.077365:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.079294:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.079320:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970113.081089:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.083283:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.083318:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.083322:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.083329:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.083361:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.083448:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.083457:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.083488:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788970113.083703:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970113.083710:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083718:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970113.083724:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083732:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083752:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083759:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b4df8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083781:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970113.083820:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083826:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970113.083829:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083846:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083858:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083865:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b4dff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.083877:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.083879:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.083881:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970113.084537:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.085729:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.085739:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.085755:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.085759:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.085765:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.085779:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.085831:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.085840:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.085861:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970113.086513:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970113.086520:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.086531:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970113.086535:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.086544:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.086563:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.086571:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b4e06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.086607:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.086609:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.086611:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.087091:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.087112:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.087124:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.087129:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.087136:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.087147:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.087156:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.087164:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.088157:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970113.089574:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.089586:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.089604:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.089609:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.089615:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.089630:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.089641:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.089649:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.091684:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788970113.092280:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970113.092291:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092306:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.092321:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092343:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092366:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092384:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092411:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.092415:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092423:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.092426:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092434:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092444:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092451:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.092594:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.092596:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.092599:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.094192:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.094203:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.094219:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.094223:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.094230:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.094243:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.094253:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.094261:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.094274:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970113.094871:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970113.094879:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.094887:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970113.094892:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.094900:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.094916:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.094922:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b4e1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970113.094941:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.094942:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970113.094944:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.103239:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.103253:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103281:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.103285:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.103290:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103304:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103315:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103322:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103357:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970113.103595:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970113.103603:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.103611:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970113.103616:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.103646:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.103663:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.103670:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b4e22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.103696:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.103697:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.103699:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970113.103905:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970113.103912:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103921:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788970113.103925:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970113.103929:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103938:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103960:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103966:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.103984:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970113.104266:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970113.104272:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.104281:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970113.104285:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.104293:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.104305:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.104322:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b4e29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.104347:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.104349:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.104351:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788970113.107698:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788970113.108759:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.108771:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.108808:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.108813:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.108820:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.109081:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.109094:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.109103:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.109122:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970113.109134:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970113.109147:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.109155:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970113.109160:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.109169:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.109186:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.109193:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.109215:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.109216:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.109218:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.110220:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.110229:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110242:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.110246:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.110251:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110273:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110282:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110290:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110306:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970113.110316:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970113.110321:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110328:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970113.110343:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110352:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110363:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110370:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.110397:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.110398:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.110400:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.112199:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.112210:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.112223:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.112228:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.112234:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.112246:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.112255:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.112264:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.112289:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970113.113130:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.113139:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.113151:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.113155:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.113166:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.113184:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.113191:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041c6d6c4/0x5d0de860b05b4e3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.113215:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.113224:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.113226:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.113680:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.114302:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.114326:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.114330:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.114348:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.114362:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.114371:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.114379:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.114393:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970113.114673:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.114680:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.114699:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.114703:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.114712:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.114727:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.114734:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b4e45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.114750:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.114752:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.114754:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.115571:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.115579:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.115590:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.115595:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.115600:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.115611:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.115648:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.115655:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.117604:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970113.119449:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970113.119461:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.119475:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970113.119480:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.119491:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.119513:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.119521:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc3947fd/0x5d0de860b05b4e4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.119550:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.119561:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.119563:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.121568:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.121578:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.121594:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.121599:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.121605:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.121620:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.121631:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.121639:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.121658:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970113.122223:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.122232:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.122241:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.122245:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.122261:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.122278:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.122285:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca00c45/0x5d0de860b05b4e53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.122307:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.122308:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.122310:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.123528:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.123539:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.123552:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.123557:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.123562:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.123583:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.123594:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.123601:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.123637:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970113.125419:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.125433:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.125445:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.125450:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.125460:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.125480:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.125510:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a25b71/0x5d0de860b05b4e5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.125541:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.125544:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.125546:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.132245:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.132261:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.132279:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.132284:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.132290:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.132304:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.132313:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.132342:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.132357:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970113.132825:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.132961:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.132972:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.132977:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.132988:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.133004:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.133012:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b4e61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.133032:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.133034:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.133036:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.136458:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.136470:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136488:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.136493:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.136499:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136512:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136521:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136529:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136548:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970113.136562:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970113.136567:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136582:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970113.136586:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136595:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136611:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136618:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f826b00/0x5d0de860b05b4e68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.136646:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.136648:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970113.136649:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.142321:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.142346:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.142363:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.142368:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.142375:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.142391:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.142411:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.142420:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.142442:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970113.142960:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.142969:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.142979:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.142984:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.142994:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.143014:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.143022:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000791e3b87/0x5d0de860b05b4e6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.143059:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.143061:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.143063:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970113.145248:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970113.145259:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.145276:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788970113.145280:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970113.145285:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.145299:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.145308:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.145315:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970113.145386:0:15072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788970113.145609:0:15072:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1788970113.145735:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14413:x1875870741527552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 149578us (149770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970113.145744:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970113.145784:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c1680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14413:1875870741527552:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788970113.145816:0:14413:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788970113.145887:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14413:1875870741527680:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788970113.145924:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970113.145970:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5f0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788970113.147276:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970113.147286:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.147299:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970113.147304:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.147328:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.147383:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.147391:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c43081b7/0x5d0de860b05b4e76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970113.147413:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.147415:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970113.147418:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970113.148180:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741527680 00000100:00100000:0.0:1788970113.148190:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741527680 00000100:00100000:0.0:1788970113.149423:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970113.149439:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14413:x1875870741527680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788970113.149496:0:15074:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788970113.159364:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14413:x1875870741527680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9923us (13431us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788970113.159378:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970113.171893:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14413:1875870741527680:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788970113.171912:0:14413:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788970113.285208:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970114.309098:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970115.014186:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970115.014211:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741527808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970115.014304:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970115.014379:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741527808 00000100:00100000:2.0:1788970115.014387:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741527808 00000100:00100000:2.0:1788970115.014440:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970115.014449:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741527808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970115.014483:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970115.014523:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741527808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970115.014529:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788970115.014563:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970115.014598:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741527808:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788970115.307748:0:16148:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788970115.340457:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970116.358138:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970117.386952:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970118.029568:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.029650:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732098816 00000100:00100000:3.0:1788970118.029661:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732098816 00000100:00100000:3.0:1788970118.029706:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:3.0:1788970118.029715:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1875870732098816:12345-192.168.202.9@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788970118.029742:0:14382:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 060bfcf6-2974-43e0-a9e8-47e12cb6b1cb@192.168.202.9@tcp t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:3.0:1788970118.032360:0:14382:0:(genops.c:1384:class_connect()) connect: client 060bfcf6-2974-43e0-a9e8-47e12cb6b1cb, cookie 0x5d0de860b05b4e7d 00000100:00080000:3.0:1788970118.032529:0:14382:0:(import.c:65:import_set_state_nolock()) ffff9777418a4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970118.032615:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+5:2352:x1875870732098816:12345-192.168.202.9@tcp:250:mount.lustre.0 Request processed in 2899us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970118.032626:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:0.0:1788970118.036396:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970118.036549:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732098944 00000100:00100000:2.0:1788970118.036560:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732098944 00000100:00100000:2.0:1788970118.036641:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:2.0:1788970118.036651:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+5:13732:x1875870732098944:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970118.036667:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970118.036684:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4e84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec55 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970118.036712:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec55 expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970118.036724:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec55 expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970118.036733:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c800, rc 0) 00000100:00100000:2.0:1788970118.037015:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+6:13732:x1875870732098944:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 365us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.037023:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:1.0:1788970118.038915:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.039058:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732099072 00000100:00100000:3.0:1788970118.039068:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732099072 00000100:00100000:3.0:1788970118.039133:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:3.0:1788970118.039143:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+6:13732:x1875870732099072:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788970118.039522:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+6:13732:x1875870732099072:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 378us (612us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788970118.039531:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:0.0:1788970118.042254:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970118.042387:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732099200 00000100:00100000:2.0:1788970118.042397:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732099200 00000100:00100000:2.0:1788970118.042495:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:2.0:1788970118.042507:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+6:13732:x1875870732099200:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970118.042525:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970118.042544:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4e8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec5c expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970118.042590:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec5c expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970118.042601:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec5c expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970118.043196:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d200, rc 0) 00000100:00100000:2.0:1788970118.043254:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+7:13732:x1875870732099200:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 749us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.043262:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:0.0:1788970118.048243:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.048346:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732099328 00000100:00100000:3.0:1788970118.048357:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732099328 00000100:00100000:3.0:1788970118.048446:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:3.0:1788970118.048468:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+7:13732:x1875870732099328:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788970118.048772:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+8:13732:x1875870732099328:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 305us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970118.048780:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:1.0:1788970118.053397:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970118.053485:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732099456 00000100:00100000:2.0:1788970118.053493:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732099456 00000100:00100000:2.0:1788970118.053558:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:2.0:1788970118.053565:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+8:13732:x1875870732099456:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788970118.053837:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+8:13732:x1875870732099456:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 270us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.053845:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:0.0:1788970118.055988:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.056097:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732099584 00000100:00100000:3.0:1788970118.056106:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732099584 00000100:00100000:3.0:1788970118.056203:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:3.0:1788970118.056213:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+8:13750:x1875870732099584:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970118.056582:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+8:13750:x1875870732099584:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 369us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970118.056595:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:0.0:1788970118.077101:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970118.077210:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732099712 00000100:00100000:2.0:1788970118.077221:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732099712 00000100:00100000:2.0:1788970118.077276:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:2.0:1788970118.077297:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+8:13750:x1875870732099712:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970118.077604:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+8:13750:x1875870732099712:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 318us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.077612:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:2.0:1788970118.086146:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741527936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970118.086226:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970118.086307:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741527936 00000100:00100000:2.0:1788970118.086315:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741527936 00000100:00100000:2.0:1788970118.086364:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970118.086373:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f466d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741527936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970118.086403:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970118.086446:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f466d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875870741527936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.086453:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788970118.086473:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970118.086517:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741527936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970118.086874:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970118.087112:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732099840 00000100:00100000:2.0:1788970118.087117:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732099840 00000100:00100000:2.0:1788970118.088309:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:2.0:1788970118.088322:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778785f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+8:13732:x1875870732099840:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970118.088338:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970118.088357:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44c400/0x5d0de860b05b4e92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec86 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970118.088384:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44c400/0x5d0de860b05b4e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec86 expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970118.088396:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44c400/0x5d0de860b05b4e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec86 expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970118.088404:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c400, rc 0) 00000100:00100000:2.0:1788970118.088461:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778785f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+9:13732:x1875870732099840:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 142us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.088481:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:1.0:1788970118.091684:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741528192:0@lo:400:kworker.0 00000100:00100000:1.0:1788970118.091753:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970118.092021:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970118.092028:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741528320:0@lo:400:kworker.0 00000100:00100000:1.0:1788970118.092055:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970118.092096:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741528192 00000100:00100000:1.0:1788970118.092104:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741528192 00000100:00100000:1.0:1788970118.092157:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970118.092166:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741528192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970118.092233:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741528192:12345-0@lo:400:kworker.0 Request processed in 68us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970118.092240:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970118.092284:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741528192:0@lo:400:kworker.0 00000100:00080000:1.0:1788970118.092315:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970118.092326:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741528448:0@lo:400:kworker.0 00000100:00100000:1.0:1788970118.092349:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970118.092367:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788970118.092373:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741528064:0@lo:400:kworker.0 00000100:00100000:1.0:1788970118.092399:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970118.092426:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741528576:0@lo:400:kworker.0 00000100:00100000:0.0:1788970118.092428:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741528320 00000100:00100000:0.0:1788970118.092432:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741528320 00000100:00100000:1.0:1788970118.092452:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970118.092460:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741528448 00000100:00100000:0.0:1788970118.092463:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741528448 00000100:00100000:1.0:1788970118.092470:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741528576 00000100:00100000:1.0:1788970118.092474:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741528576 00000100:00100000:0.0:1788970118.092481:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970118.092487:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741528320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970118.092489:0:14388:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788970118.092496:0:14388:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788970118.092508:0:14389:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788970118.092515:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970118.092520:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741528448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970118.092532:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741528320:12345-0@lo:400:kworker.0 Request processed in 46us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.092539:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970118.092548:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741528448:12345-0@lo:400:kworker.0 Request processed in 28us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.092550:0:14390:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788970118.092554:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970118.092557:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788970118.092563:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741528576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970118.092589:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741528576:12345-0@lo:400:kworker.0 Request processed in 27us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.092594:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788970118.092650:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788970118.092671:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778650c1680 x1875870741528320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970118.092682:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741528320:0@lo:400:kworker.0 00010000:00080000:1.0:1788970118.092712:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778650c3c00 x1875870741528576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970118.092721:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741528576:0@lo:400:kworker.0 00010000:00080000:1.0:1788970118.092731:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9778650c30c0 x1875870741528448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970118.092737:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741528448:0@lo:400:kworker.0 00000100:00100000:1.0:1788970118.093491:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741528064 00000100:00100000:1.0:1788970118.093500:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741528064 00000100:00100000:1.0:1788970118.093536:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788970118.093543:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:3285:x1875870741528064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970118.093595:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:3285:x1875870741528064:12345-0@lo:400:kworker.0 Request processed in 53us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970118.093600:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788970118.093634:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741528064:0@lo:400:kworker.0 00000100:00100000:0.0:1788970118.110568:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970118.110605:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732099968 00000100:00100000:0.0:1788970118.110614:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732099968 00000100:00100000:0.0:1788970118.110658:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:0.0:1788970118.110666:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+9:13732:x1875870732099968:12345-192.168.202.9@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788970118.110690:0:14380:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788970118.110710:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788970118.110714:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788970118.110717:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788970118.110719:0:14380:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788970118.126840:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+9:13732:x1875870732099968:12345-192.168.202.9@tcp:256:mount.lustre.0 Request processed in 16161us (16268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970118.126856:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:3.0:1788970118.132248:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.132282:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732100096 00000100:00100000:3.0:1788970118.132301:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732100096 00000100:00100000:3.0:1788970118.132357:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:3.0:1788970118.132367:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+9:13732:x1875870732100096:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788970118.132383:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970118.132399:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ec8d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970118.132440:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec8d expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970118.132470:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec8d expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970118.132480:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8a00, rc 0) 00000100:00100000:3.0:1788970118.132540:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13732:x1875870732100096:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 174us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970118.132546:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:1.0:1788970118.134106:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.134150:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732100224 00000100:00100000:3.0:1788970118.134157:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732100224 00000100:00100000:3.0:1788970118.134191:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:3.0:1788970118.134198:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13732:x1875870732100224:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970118.134561:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13732:x1875870732100224:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 362us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.134570:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:2.0:1788970118.136063:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970118.136193:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732100352 00000100:00100000:0.0:1788970118.136200:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732100352 00000100:00100000:0.0:1788970118.136242:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:0.0:1788970118.136251:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13732:x1875870732100352:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788970118.136589:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13732:x1875870732100352:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 338us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.136597:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:3.0:1788970118.138712:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970118.139053:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732100480 00000100:00100000:1.0:1788970118.139062:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732100480 00000100:00100000:1.0:1788970118.139102:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:1.0:1788970118.139111:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13754:x1875870732100480:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970118.139337:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13754:x1875870732100480:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 226us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970118.139345:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 89 00000100:00100000:2.0:1788970118.148124:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.148240:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732100608 00000100:00100000:3.0:1788970118.148249:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732100608 00000100:00100000:3.0:1788970118.148315:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:3.0:1788970118.148324:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13754:x1875870732100608:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970118.148544:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13754:x1875870732100608:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 220us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970118.148552:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:2.0:1788970118.158329:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970118.161401:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732100736 00000100:00100000:1.0:1788970118.161417:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732100736 00000100:00100000:1.0:1788970118.161500:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:1.0:1788970118.161509:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f465e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875870732100736:12345-192.168.202.9@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788970118.161540:0:14389:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 37f81da6-3302-422f-ab81-440f8fa5e2ee@192.168.202.9@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1788970118.161584:0:14389:0:(genops.c:1384:class_connect()) connect: client 37f81da6-3302-422f-ab81-440f8fa5e2ee, cookie 0x5d0de860b05b4ea0 00000004:00100000:1.0:1788970118.161614:0:14389:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1788970118.161620:0:14389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788970118.204902:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788970118.204935:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1788970118.219221:0:14389:0:(import.c:65:import_set_state_nolock()) ffff9778798bc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970118.219341:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f465e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2352:x1875870732100736:12345-192.168.202.9@tcp:38:mount.lustre.0 Request processed in 57830us (61018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.219352:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:2.0:1788970118.222651:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970118.223352:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970118.223697:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732100864 00000100:00100000:1.0:1788970118.223708:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732100864 00000100:00100000:0.0:1788970118.223754:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732100992 00000100:00100000:0.0:1788970118.224010:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732100992 00000100:00100000:0.0:1788970118.224109:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1788970118.224119:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:13732:x1875870732100992:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970118.224159:0:16264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788970118.224242:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:13732:x1875870732100992:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 124us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.224249:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1788970118.224283:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788970118.224300:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:0:x1875870732100864:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970118.224311:0:14388:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788970118.224330:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:0:x1875870732100864:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 31us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.224336:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:3.0:1788970118.226008:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970118.226167:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732101120 00000100:00100000:0.0:1788970118.226175:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732101120 00000100:00100000:0.0:1788970118.226219:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970118.226227:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:13732:x1875870732101120:12345-192.168.202.9@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788970118.226300:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:13732:x1875870732101120:12345-192.168.202.9@tcp:40:mount.lustre.0 Request processed in 72us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.226307:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:3.0:1788970118.228935:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.228969:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.228993:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970118.229029:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970118.229162:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732101504 00000100:00100000:2.0:1788970118.229170:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732101504 00000100:00100000:2.0:1788970118.229207:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:2.0:1788970118.229214:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:13732:x1875870732101504:12345-192.168.202.9@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788970118.229421:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732101248 00000100:00100000:0.0:1788970118.229425:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732101248 00000100:00100000:0.0:1788970118.229451:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732101376 00000100:00100000:0.0:1788970118.229453:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732101376 00000100:00100000:0.0:1788970118.229468:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:0.0:1788970118.229473:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875870732101248:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788970118.229494:0:15074:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 37f81da6-3302-422f-ab81-440f8fa5e2ee@192.168.202.9@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:0.0:1788970118.229518:0:15074:0:(genops.c:1384:class_connect()) connect: client 37f81da6-3302-422f-ab81-440f8fa5e2ee, cookie 0x5d0de860b05b4ea7 00002000:00100000:0.0:1788970118.229529:0:15074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 37f81da6-3302-422f-ab81-440f8fa5e2ee/ffff9778798bb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788970118.229550:0:15074:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:2.0:1788970118.229883:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1788970118.229888:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875870732101376:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788970118.229904:0:15073:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 37f81da6-3302-422f-ab81-440f8fa5e2ee@192.168.202.9@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:2.0:1788970118.229919:0:15073:0:(genops.c:1384:class_connect()) connect: client 37f81da6-3302-422f-ab81-440f8fa5e2ee, cookie 0x5d0de860b05b4eae 00002000:00100000:2.0:1788970118.229924:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 37f81da6-3302-422f-ab81-440f8fa5e2ee/ffff97787a6c6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788970118.229930:0:15073:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788970118.230117:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788970118.230143:0:15073:0:(import.c:65:import_set_state_nolock()) ffff97787a6c4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970118.230195:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2352:x1875870732101376:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 305us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.230202:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00002000:00080000:0.0:1788970118.231309:0:15074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788970118.231343:0:15074:0:(import.c:65:import_set_state_nolock()) ffff9778798ba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970118.231395:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2352:x1875870732101248:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 1921us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.231403:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788970118.232130:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732101632 00000100:00100000:2.0:1788970118.232138:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732101632 00000100:00100000:2.0:1788970118.232185:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00100000:2.0:1788970118.232193:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:2355:x1875870732101632:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970118.232232:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:2355:x1875870732101632:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 40us (3201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.232238:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00080000:1.0:1788970118.233459:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788970118.237559:0:14391:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8284us 00000004:00200000:2.0:1788970118.250342:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788970118.250455:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:13732:x1875870732101504:12345-192.168.202.9@tcp:33:mount.lustre.0 Request processed in 21237us (21523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970118.250467:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00010000:00010000:2.0:1788970118.405164:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970118.423455:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970118.423556:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732101760 00000100:00100000:0.0:1788970118.423566:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732101760 00000100:00100000:0.0:1788970118.423635:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:0.0:1788970118.423646:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:13775:x1875870732101760:12345-192.168.202.9@tcp:101:mkdir.0 00010000:00010000:0.0:1788970118.423668:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970118.423695:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4400/0x5d0de860b05b4eb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ecb7 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970118.423774:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b4ebc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970118.423819:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b4ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970118.423847:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b4ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970118.424151:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788970118.424155:0:14389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970118.424190:0:14389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b4ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970118.424216:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4400/0x5d0de860b05b4eb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecb7 expref: 8 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970118.424240:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b4ebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecb7 expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970118.424249:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672c00) 00010000:00010000:0.0:1788970118.424252:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970118.424256:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4a00, rc 0) 00000100:00100000:0.0:1788970118.424330:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:13775:x1875870732101760:12345-192.168.202.9@tcp:101:mkdir.0 Request processed in 686us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970118.424337:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000001:00100000:1.0:1788970118.680210:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 37f81da6-3302-422f-ab81-440f8fa5e2ee 00010000:00010000:3.0:1788970119.430681:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970120.134467:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970120.134490:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f465680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741528704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970120.134556:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970120.134851:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741528704 00000100:00100000:2.0:1788970120.134859:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741528704 00000100:00100000:2.0:1788970120.134929:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970120.134939:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741528704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970120.134975:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970120.135029:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741528704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.135036:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970120.135117:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f465680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741528704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788970120.135173:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788970120.453045:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970120.545972:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970120.546199:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732101888 00000100:00100000:0.0:1788970120.546208:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732101888 00000100:00100000:0.0:1788970120.546293:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:0.0:1788970120.546304:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:13827:x1875870732101888:12345-192.168.202.9@tcp:41:lfs.0 00000004:00000024:0.0:1788970120.546347:0:14388:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788970120.546432:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:13827:x1875870732101888:12345-192.168.202.9@tcp:41:lfs.0 Request processed in 130us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970120.546451:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00080000:1.0:1788970120.546566:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970120.551038:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970120.551349:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732102016 00000100:00100000:0.0:1788970120.551358:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732102016 00000100:00100000:0.0:1788970120.551414:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788970120.551422:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f464b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:13827:x1875870732102016:12345-192.168.202.9@tcp:13:lfs.0 00002000:00000024:0.0:1788970120.551443:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970120.551516:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f464b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:13827:x1875870732102016:12345-192.168.202.9@tcp:13:lfs.0 Request processed in 85us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970120.551523:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00080000:2.0:1788970120.551581:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970120.554499:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970120.554612:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732102144 00000100:00100000:0.0:1788970120.554621:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732102144 00000100:00100000:0.0:1788970120.554684:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970120.554691:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:13827:x1875870732102144:12345-192.168.202.9@tcp:13:lfs.0 00002000:00000024:0.0:1788970120.554722:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970120.554818:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:13827:x1875870732102144:12345-192.168.202.9@tcp:13:lfs.0 Request processed in 127us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970120.554822:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00080000:2.0:1788970120.554983:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970120.701181:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970120.701324:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732102272 00000100:00100000:0.0:1788970120.701336:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732102272 00000100:00100000:0.0:1788970120.701395:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:0.0:1788970120.701403:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:13858:x1875870732102272:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788970120.701421:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970120.701438:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4400/0x5d0de860b05b4ec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ecbe expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970120.701467:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4400/0x5d0de860b05b4ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecbe expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970120.701490:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4400/0x5d0de860b05b4ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecbe expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970120.701500:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4400, rc 0) 00000100:00100000:0.0:1788970120.701563:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13858:x1875870732102272:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 160us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970120.701570:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:1.0:1788970120.722242:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970120.722345:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732102400 00000100:00100000:3.0:1788970120.722357:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732102400 00000100:00100000:3.0:1788970120.722428:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:3.0:1788970120.722438:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13858:x1875870732102400:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788970120.722752:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13858:x1875870732102400:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 314us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970120.722771:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:3.0:1788970120.724233:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970120.724381:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732102528 00000100:00100000:0.0:1788970120.724390:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732102528 00000100:00100000:0.0:1788970120.724438:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:0.0:1788970120.724448:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13858:x1875870732102528:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788970120.724741:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13858:x1875870732102528:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 293us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970120.724750:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:0.0:1788970120.728285:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970120.728388:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732102656 00000100:00100000:2.0:1788970120.728411:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732102656 00000100:00100000:2.0:1788970120.728467:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00100000:2.0:1788970120.728477:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13865:x1875870732102656:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970120.728861:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13865:x1875870732102656:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 384us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.728870:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00100000:1.0:1788970120.757200:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970120.757254:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732102784 00000100:00100000:3.0:1788970120.757292:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732102784 00000100:00100000:3.0:1788970120.757355:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:3.0:1788970120.757366:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13865:x1875870732102784:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970120.758994:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13865:x1875870732102784:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 1619us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970120.759006:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:3.0:1788970120.768163:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970120.768550:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732102912 00000100:00100000:0.0:1788970120.768563:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732102912 00000100:00100000:0.0:1788970120.768616:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:0.0:1788970120.768626:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13858:x1875870732102912:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788970120.768643:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970120.768659:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4600/0x5d0de860b05b4eca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ece8 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970120.768686:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4600/0x5d0de860b05b4eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ece8 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970120.768713:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4600/0x5d0de860b05b4eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ece8 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970120.768722:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4600, rc 0) 00000100:00100000:0.0:1788970120.768787:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13858:x1875870732102912:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 161us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970120.768826:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:0.0:1788970120.785534:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970120.785637:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732103040 00000100:00100000:2.0:1788970120.785648:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732103040 00000100:00100000:2.0:1788970120.785704:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:2.0:1788970120.785714:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dcc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13858:x1875870732103040:12345-192.168.202.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788970120.785738:0:14380:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788970120.785769:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788970120.785774:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788970120.785777:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788970120.785780:0:14380:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788970120.797324:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dcc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13858:x1875870732103040:12345-192.168.202.9@tcp:256:mount.lustre.0 Request processed in 11600us (11788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.797341:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:3.0:1788970120.806299:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970120.807595:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732103168 00000100:00100000:2.0:1788970120.807608:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732103168 00000100:00100000:2.0:1788970120.807672:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:2.0:1788970120.807682:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13858:x1875870732103168:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970120.807699:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970120.807718:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ecef expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970120.807746:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecef expref: 13 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970120.807785:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecef expref: 13 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970120.807822:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44ca00, rc 0) 00000100:00100000:2.0:1788970120.807892:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13858:x1875870732103168:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 211us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.807899:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:0.0:1788970120.812181:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970120.812348:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732103296 00000100:00100000:2.0:1788970120.812360:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732103296 00000100:00100000:2.0:1788970120.812419:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:2.0:1788970120.812430:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13858:x1875870732103296:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970120.812759:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13858:x1875870732103296:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 330us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.812775:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:1.0:1788970120.818859:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970120.818962:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732103424 00000100:00100000:0.0:1788970120.818973:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732103424 00000100:00100000:0.0:1788970120.819031:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:0.0:1788970120.819042:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13858:x1875870732103424:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788970120.819335:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13858:x1875870732103424:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 294us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970120.819343:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:0.0:1788970120.828708:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970120.829425:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732103552 00000100:00100000:3.0:1788970120.829439:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732103552 00000100:00100000:3.0:1788970120.829525:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 102 00000100:00100000:3.0:1788970120.829536:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13869:x1875870732103552:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970120.830158:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13869:x1875870732103552:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 621us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970120.830167:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 102 00000100:00100000:3.0:1788970120.841124:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970120.841277:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732103680 00000100:00100000:2.0:1788970120.841288:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732103680 00000100:00100000:2.0:1788970120.841343:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:2.0:1788970120.841354:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13869:x1875870732103680:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970120.841615:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13869:x1875870732103680:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 262us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.841623:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:1.0:1788970120.854314:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970120.854420:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732103808 00000100:00100000:2.0:1788970120.854432:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732103808 00000100:00100000:2.0:1788970120.854485:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788970120.854493:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1875870732103808:12345-192.168.202.9@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788970120.854541:0:16264:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ed26fada-f3c3-4d29-9040-b6cb88c25b67@192.168.202.9@tcp t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:2.0:1788970120.854581:0:16264:0:(genops.c:1384:class_connect()) connect: client ed26fada-f3c3-4d29-9040-b6cb88c25b67, cookie 0x5d0de860b05b4ed8 00000004:00100000:2.0:1788970120.854612:0:16264:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788970120.854730:0:16264:0:(import.c:65:import_set_state_nolock()) ffff97787a6c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970120.854844:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2352:x1875870732103808:12345-192.168.202.9@tcp:38:mount.lustre.0 Request processed in 351us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.854851:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1788970120.863772:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970120.863856:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970120.864018:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732104064 00000100:00100000:3.0:1788970120.864028:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732104064 00000100:00100000:3.0:1788970120.864097:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732103936 00000100:00100000:3.0:1788970120.864100:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732103936 00000100:00100000:3.0:1788970120.864120:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1788970120.864130:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+7:13858:x1875870732104064:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788970120.864162:0:14388:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788970120.864229:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+7:13858:x1875870732104064:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 100us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970120.864236:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1788970120.864251:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1788970120.864258:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:0:x1875870732103936:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788970120.864301:0:14388:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788970120.864322:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:0:x1875870732103936:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 65us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970120.864328:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00080000:1.0:1788970120.864379:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970120.876450:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970120.877472:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732104192 00000100:00100000:0.0:1788970120.877483:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732104192 00000100:00100000:0.0:1788970120.877555:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:0.0:1788970120.877565:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:13858:x1875870732104192:12345-192.168.202.9@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788970120.877654:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:13858:x1875870732104192:12345-192.168.202.9@tcp:40:mount.lustre.0 Request processed in 90us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970120.877679:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1788970120.883559:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970120.883600:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970120.883697:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732104320 00000100:00100000:2.0:1788970120.883708:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732104320 00000100:00100000:2.0:1788970120.883755:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732104448 00000100:00100000:2.0:1788970120.883768:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732104448 00000100:00100000:2.0:1788970120.883819:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788970120.883837:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875870732104320:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788970120.883866:0:15073:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ed26fada-f3c3-4d29-9040-b6cb88c25b67@192.168.202.9@tcp t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:2.0:1788970120.883895:0:15073:0:(genops.c:1384:class_connect()) connect: client ed26fada-f3c3-4d29-9040-b6cb88c25b67, cookie 0x5d0de860b05b4edf 00002000:00100000:2.0:1788970120.883905:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed26fada-f3c3-4d29-9040-b6cb88c25b67/ffff97787a6c4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788970120.883915:0:15073:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788970120.884146:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788970120.884170:0:15073:0:(import.c:65:import_set_state_nolock()) ffff97787a6c3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970120.884219:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2352:x1875870732104320:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 393us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.884225:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788970120.884238:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1788970120.884241:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875870732104448:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788970120.884251:0:15073:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ed26fada-f3c3-4d29-9040-b6cb88c25b67@192.168.202.9@tcp t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:2.0:1788970120.884289:0:15073:0:(genops.c:1384:class_connect()) connect: client ed26fada-f3c3-4d29-9040-b6cb88c25b67, cookie 0x5d0de860b05b4ee6 00002000:00100000:2.0:1788970120.884295:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed26fada-f3c3-4d29-9040-b6cb88c25b67/ffff97787a6c0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788970120.884301:0:15073:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788970120.884358:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788970120.884374:0:15073:0:(import.c:65:import_set_state_nolock()) ffff97787a6c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970120.884396:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2352:x1875870732104448:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 152us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.884403:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1788970120.885079:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970120.886298:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732104576 00000100:00100000:2.0:1788970120.886308:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732104576 00000100:00100000:2.0:1788970120.886406:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:2.0:1788970120.886416:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:13858:x1875870732104576:12345-192.168.202.9@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788970120.886488:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788970120.886569:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:13858:x1875870732104576:12345-192.168.202.9@tcp:33:mount.lustre.0 Request processed in 154us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970120.886576:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:2.0:1788970121.027158:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970121.027255:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732104704 00000100:00100000:0.0:1788970121.027275:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732104704 00000100:00100000:0.0:1788970121.027332:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:0.0:1788970121.027342:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:13890:x1875870732104704:12345-192.168.202.9@tcp:101:mkdir.0 00010000:00010000:0.0:1788970121.027363:0:16264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970121.027383:0:16264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b4eed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed19 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970121.027444:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970121.027460:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970121.027471:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970121.027506:0:16264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788970121.027510:0:16264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970121.027527:0:16264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970121.027551:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b4eed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed19 expref: 8 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970121.027569:0:16264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed19 expref: 7 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970121.027604:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672c00) 00010000:00010000:0.0:1788970121.027607:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970121.027611:0:16264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4e00, rc 0) 00000100:00100000:0.0:1788970121.027677:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+7:13890:x1875870732104704:12345-192.168.202.9@tcp:101:mkdir.0 Request processed in 336us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970121.027685:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00010000:00010000:3.0:1788970121.477510:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970121.733661:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788970122.501870:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970123.205447:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741529216:0@lo:400:kworker.0 00000100:00100000:1.0:1788970123.205515:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970123.205589:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788970123.205596:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741528832:0@lo:400:kworker.0 00000100:00100000:1.0:1788970123.205625:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970123.205643:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741529344:0@lo:400:kworker.0 00000100:00100000:1.0:1788970123.205660:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970123.205683:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741528960:0@lo:400:kworker.0 00000100:00100000:1.0:1788970123.205722:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970123.205739:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741529472:0@lo:400:kworker.0 00000100:00100000:1.0:1788970123.205762:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970123.205779:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970123.205784:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741529088:0@lo:400:kworker.0 00000100:00100000:1.0:1788970123.205823:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970123.206061:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741528832 00000100:00100000:0.0:1788970123.206069:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741528832 00000100:00100000:0.0:1788970123.206125:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788970123.206135:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:3283:x1875870741528832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970123.206189:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:3283:x1875870741528832:12345-0@lo:400:kworker.0 Request processed in 56us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970123.206196:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788970123.206227:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741529216 00000100:00100000:0.0:1788970123.206230:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741529216 00000100:00100000:0.0:1788970123.206264:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741529344 00000100:00100000:0.0:1788970123.206268:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741529344 00000100:00100000:0.0:1788970123.206288:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741529472 00000100:00100000:0.0:1788970123.206290:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741529472 00000100:00100000:0.0:1788970123.206304:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788970123.206310:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741529216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970123.206342:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741529216:12345-0@lo:400:kworker.0 Request processed in 32us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970123.206348:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788970123.206361:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970123.206387:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741529344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970123.206416:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741529344:12345-0@lo:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970123.206422:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970123.206435:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970123.206441:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741529472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970123.206472:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741529472:12345-0@lo:400:kworker.0 Request processed in 31us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970123.206477:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788970123.206496:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970123.206526:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741529472:0@lo:400:kworker.0 00000100:00100000:0.0:1788970123.206557:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741528832:0@lo:400:kworker.0 00000100:00100000:0.0:1788970123.206577:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741529344:0@lo:400:kworker.0 00000100:00100000:0.0:1788970123.206586:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741529216:0@lo:400:kworker.0 00000100:00100000:2.0:1788970123.207087:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741528960 00000100:00100000:2.0:1788970123.207094:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741528960 00000100:00100000:2.0:1788970123.207136:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741529088 00000100:00100000:2.0:1788970123.207140:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741529088 00000100:00100000:2.0:1788970123.207162:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970123.207169:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741528960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970123.207213:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741528960:12345-0@lo:400:kworker.0 Request processed in 45us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970123.207230:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970123.207254:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970123.207260:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741529088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970123.207289:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741529088:12345-0@lo:400:kworker.0 Request processed in 30us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970123.207294:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970123.207818:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741529600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970123.207857:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970123.210313:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741529600 00000100:00100000:0.0:1788970123.210326:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741529600 00000100:00100000:0.0:1788970123.210390:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970123.210401:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f465a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741529600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970123.210435:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970123.210519:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f465a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741529600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970123.210526:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788970123.210550:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970123.210555:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970123.210719:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788970123.210740:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741529600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970123.210771:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741529088:0@lo:400:kworker.0 00000100:00100000:0.0:1788970123.210782:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741528960:0@lo:400:kworker.0 00000001:00100000:3.0:1788970123.301758:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed26fada-f3c3-4d29-9040-b6cb88c25b67 00000001:00100000:3.0:1788970123.301784:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37f81da6-3302-422f-ab81-440f8fa5e2ee 00000001:00100000:2.0:1788970123.337540:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 37f81da6-3302-422f-ab81-440f8fa5e2ee 00000001:00100000:2.0:1788970123.337557:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed26fada-f3c3-4d29-9040-b6cb88c25b67 00010000:00010000:3.0:1788970123.525432:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788970123.826320:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed26fada-f3c3-4d29-9040-b6cb88c25b67 00010000:00010000:0.0:1788970124.557125:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788970124.728521:0:16357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788970125.256663:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970125.256688:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f466940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741529728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970125.256778:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970125.257073:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741529728 00000100:00100000:2.0:1788970125.257081:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741529728 00000100:00100000:2.0:1788970125.257144:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970125.257153:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741529728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970125.257186:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970125.257267:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741529728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970125.257275:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788970125.257584:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970125.257718:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f466940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741529728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788970125.573252:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970126.397234:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970126.397274:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970126.397296:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970126.397321:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970126.397339:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970126.397357:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970126.397377:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970126.397400:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732105216 00000100:00100000:0.0:1788970126.397409:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732105216 00000100:00100000:0.0:1788970126.397454:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732105472 00000100:00100000:0.0:1788970126.397457:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732105472 00000100:00100000:0.0:1788970126.397468:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732105088 00000100:00100000:0.0:1788970126.397470:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732105088 00000100:00100000:0.0:1788970126.397479:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732105600 00000100:00100000:0.0:1788970126.397481:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732105600 00000100:00100000:0.0:1788970126.397496:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1788970126.397505:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2356:x1875870732105216:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970126.397573:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2356:x1875870732105216:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 68us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970126.397580:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1788970126.397596:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788970126.397611:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2356:x1875870732105472:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970126.397637:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2356:x1875870732105472:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970126.397644:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788970126.397655:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970126.397660:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2356:x1875870732105088:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970126.397680:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2356:x1875870732105088:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 21us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970126.397686:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970126.397694:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:0.0:1788970126.397700:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2356:x1875870732105600:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970126.397716:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2356:x1875870732105600:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 17us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970126.397721:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:0.0:1788970126.397740:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732104832 00000100:00100000:0.0:1788970126.397744:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732104832 00000100:00100000:0.0:1788970126.397765:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 105 00000100:00100000:0.0:1788970126.397770:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2356:x1875870732104832:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970126.397808:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2356:x1875870732104832:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 38us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970126.397814:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 105 00000100:00100000:0.0:1788970126.397843:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732104960 00000100:00100000:0.0:1788970126.397847:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732104960 00000100:00100000:0.0:1788970126.397872:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732105344 00000100:00100000:0.0:1788970126.397880:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732105344 00000100:00100000:0.0:1788970126.397903:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:0.0:1788970126.397909:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2356:x1875870732104960:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970126.397935:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2356:x1875870732104960:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970126.397941:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:0.0:1788970126.397951:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:0.0:1788970126.397957:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2356:x1875870732105344:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970126.397977:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2356:x1875870732105344:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 21us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970126.397983:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00080000:0.0:1788970126.397999:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970126.398003:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970126.398006:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788970126.597488:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970127.625946:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970128.328485:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970128.328510:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741529856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970128.328577:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970128.329400:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741529856 00000100:00100000:2.0:1788970128.329410:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741529856 00000100:00100000:2.0:1788970128.329510:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970128.329521:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741529856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970128.329565:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970128.329631:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741529856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970128.329649:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788970128.330818:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970128.331458:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741529856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970128.332826:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741529984:0@lo:400:kworker.0 00000100:00100000:1.0:1788970128.332894:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970128.332953:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741529984 00000100:00100000:1.0:1788970128.332961:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741529984 00000100:00100000:1.0:1788970128.333002:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788970128.333011:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:3285:x1875870741529984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970128.333377:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:3285:x1875870741529984:12345-0@lo:400:kworker.0 Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970128.333387:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788970128.333460:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741529984:0@lo:400:kworker.0 00000100:00100000:1.0:1788970128.333752:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741530112:0@lo:400:kworker.0 00000100:00100000:1.0:1788970128.334997:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970128.335046:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741530112 00000100:00100000:1.0:1788970128.335060:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741530112 00000100:00100000:1.0:1788970128.335107:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970128.335115:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741530112:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788970128.335664:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970128.337313:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741530112:12345-0@lo:400:kworker.0 Request processed in 2191us (2310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970128.337751:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970128.338045:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878938b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741530496:0@lo:400:kworker.0 00000100:00100000:1.0:1788970128.338088:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970128.339071:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878938f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741530368:0@lo:400:kworker.0 00000100:00100000:3.0:1788970128.339115:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970128.339154:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970128.339161:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878939a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741530240:0@lo:400:kworker.0 00000100:00100000:3.0:1788970128.339181:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970128.339221:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741530496 00000100:00100000:3.0:1788970128.339229:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741530496 00000100:00100000:3.0:1788970128.339274:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741530368 00000100:00100000:3.0:1788970128.339278:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741530368 00000100:00100000:3.0:1788970128.339294:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741530240 00000100:00100000:3.0:1788970128.339296:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741530240 00000100:00100000:3.0:1788970128.339310:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788970128.339338:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741530496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970128.339392:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741530496:12345-0@lo:400:kworker.0 Request processed in 75us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970128.339398:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788970128.339413:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788970128.339418:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741530368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970128.339445:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741530368:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970128.339450:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788970128.339460:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788970128.339465:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741530240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970128.339502:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741530240:12345-0@lo:400:kworker.0 Request processed in 37us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970128.339508:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788970128.339546:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878939a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741530240:0@lo:400:kworker.0 00000100:00100000:3.0:1788970128.339556:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878938f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741530368:0@lo:400:kworker.0 00000100:00080000:3.0:1788970128.339576:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970128.339593:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741530112:0@lo:400:kworker.0 00000100:00100000:3.0:1788970128.339617:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878938b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741530496:0@lo:400:kworker.0 00010000:00010000:0.0:1788970128.651403:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788970128.976463:0:16506:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe54afa30 20000000:00000080:1.0:1788970128.978138:0:16506:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97787a2dec00 uarg=0000000000000000 20000000:01000000:1.0:1788970128.978201:0:16506:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788970128.978207:0:16506:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788970128.978213:0:16506:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788970128.988436:0:16507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788970128.989316:0:16506:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788970129.005023:0:16506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788970129.005080:0:16506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005101:0:16506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4beb expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005110:0:16506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4c38 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005117:0:16506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4d73 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005129:0:16506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec8d expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005155:0:16506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecef expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005163:0:16506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005222:0:16506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecef expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005239:0:16506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecef expref: 12 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970129.005254:0:16506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878939e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741530624:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970129.005403:0:16506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec8d expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005412:0:16506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec8d expref: 12 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970129.005421:0:16506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878938000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741530752:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970129.005452:0:16506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b4d73 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.005461:0:16506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b4d73 expref: 18 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970129.005470:0:16506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787893b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741530880:0@lo:104: 00000100:00100000:1.0:1788970129.005537:0:16506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970129.007671:0:16506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b4c38 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.007701:0:16506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b4c38 expref: 18 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970129.007714:0:16506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878939680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741531008:0@lo:104: 00000100:00100000:1.0:1788970129.007760:0:16506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970129.011698:0:16506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b4beb expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.011719:0:16506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b4beb expref: 18 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970129.011734:0:16506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878938780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741531136:0@lo:104: 00000100:00100000:1.0:1788970129.011814:0:16506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970129.017958:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970129.017994:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970129.018023:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732105728 00000100:00100000:3.0:1788970129.018031:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732105728 00010000:00010000:3.0:1788970129.018085:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecef expref: 13 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970129.018116:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732105856 00000100:00100000:3.0:1788970129.018119:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732105856 00010000:00010000:3.0:1788970129.018133:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec8d expref: 14 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970129.018148:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1788970129.018157:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+14:2353:x1875870732105728:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970129.018171:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970129.018176:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecef expref: 14 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.018218:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecef expref: 14 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.018238:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970129.018287:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+14:2353:x1875870732105728:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 131us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970129.018295:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1788970129.018311:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:3.0:1788970129.018319:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2353:x1875870732105856:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970129.018327:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970129.018331:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec8d expref: 13 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.018340:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec8d expref: 13 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.018349:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970129.018365:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2353:x1875870732105856:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970129.018370:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1788970129.020507:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741530880 00000100:00100000:0.0:1788970129.020520:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741530880 00000100:00100000:0.0:1788970129.020575:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741531008 00000100:00100000:0.0:1788970129.020578:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741531008 00000100:00100000:0.0:1788970129.020596:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970129.020603:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+4:16506:x1875870741530880:12345-0@lo:104: 00010000:00010000:0.0:1788970129.020619:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970129.020710:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970129.020716:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+4:16506:x1875870741530880:12345-0@lo:104: Request processed in 114us (15180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970129.020723:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970129.020740:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970129.020745:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:16506:x1875870741531008:12345-0@lo:104: 00010000:00010000:0.0:1788970129.020753:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970129.020786:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788970129.020808:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:16506:x1875870741531008:12345-0@lo:104: Request processed in 63us (13049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970129.020813:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788970129.020899:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970129.020905:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.020913:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788970129.020916:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.020925:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970129.020933:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970129.020938:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970129.020981:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.020989:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970129.021011:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021018:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977880f93400/0x5d0de860b05b4d73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4d7a expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021032:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970129.021044:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021050:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788970129.021053:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021059:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970129.021066:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970129.021071:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970129.021085:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021090:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970129.021105:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021111:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b4c38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4c3f expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021120:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970129.021121:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970129.021123:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970129.021136:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741531264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970129.021176:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970129.021234:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f466940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741531392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970129.021265:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970129.021306:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741531264 00000100:00100000:2.0:1788970129.021310:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741531264 00010000:00010000:2.0:1788970129.021327:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4d73 expref: 19 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970129.021344:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741531392 00000100:00100000:2.0:1788970129.021346:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741531392 00010000:00010000:2.0:1788970129.021355:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4c38 expref: 20 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970129.021365:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970129.021370:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de37645b-91a3-4bf2-a071-03e750936262+20:3286:x1875870741531264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970129.021380:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970129.021384:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4d73 expref: 20 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021393:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b4d73 expref: 20 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021408:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970129.021433:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de37645b-91a3-4bf2-a071-03e750936262+20:3286:x1875870741531264:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970129.021439:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970129.021635:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970129.021644:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f465680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de37645b-91a3-4bf2-a071-03e750936262+19:3283:x1875870741531392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970129.021652:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970129.021656:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4c38 expref: 19 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021678:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b4c38 expref: 19 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970129.021698:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970129.021725:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f465680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de37645b-91a3-4bf2-a071-03e750936262+19:3283:x1875870741531392:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970129.021730:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788970129.022937:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970129.023147:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f466940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741531392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970129.023200:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741531264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970129.024747:0:16506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed300 going to sleep for 11 seconds 00010000:00010000:1.0:1788970129.024806:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4ed1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecef expref: 12 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970129.024826:0:16506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878939e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741530624:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970129.024840:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a8a00/0x5d0de860b05b4e99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec8d expref: 11 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970129.024850:0:16506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878938000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741530752:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970129.024861:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4d7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b4d73 expref: 18 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970129.024874:0:16506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787893b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741530880:0@lo:104: 00010000:00010000:1.0:1788970129.024905:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44de00/0x5d0de860b05b4c3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b4c38 expref: 17 pid: 14382 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970129.024913:0:16506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878939680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741531008:0@lo:104: 00000100:00100000:0.0:1788970129.029835:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788970129.029866:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741531136 00000100:00100000:0.0:1788970129.029877:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741531136 00000100:00100000:0.0:1788970129.029939:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970129.029948:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977858b61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:16506:x1875870741531136:12345-0@lo:104: 00010000:00010000:0.0:1788970129.029966:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970129.030061:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970129.030067:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977858b61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de37645b-91a3-4bf2-a071-03e750936262+3:16506:x1875870741531136:12345-0@lo:104: Request processed in 122us (18255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970129.030075:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970129.030359:0:16506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878938780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16506:1875870741531136:0@lo:104: 00010000:00010000:1.0:1788970129.030392:0:16506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.030504:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970129.030512:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.030519:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd000 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970129.030523:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.030546:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970129.030553:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970129.030559:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970129.030591:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.030597:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970129.030629:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.030636:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778821dd000/0x5d0de860b05b4beb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b4bf2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.030654:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970129.030655:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970129.030657:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970129.030709:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741531520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970129.030762:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970129.031008:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741531520 00000100:00100000:3.0:1788970129.031014:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741531520 00010000:00010000:3.0:1788970129.031036:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4beb expref: 17 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970129.031065:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970129.031072:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de37645b-91a3-4bf2-a071-03e750936262+17:3284:x1875870741531520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970129.031084:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970129.031088:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b4beb expref: 17 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031108:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b4beb expref: 17 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031122:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44ce00/0x5d0de860b05b4bf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b4beb expref: 17 pid: 14383 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031136:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031144:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031158:0:14374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031165:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031173:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031180:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031194:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970129.031199:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031207:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031229:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970129.031237:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970129.031261:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de37645b-91a3-4bf2-a071-03e750936262+16:3284:x1875870741531520:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970129.031265:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788970129.031306:0:16506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.031312:0:16506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970129.031316:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f93c00/0x5d0de860b05b4efb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970129.033111:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741531520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970129.670592:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970130.373129:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970130.373155:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f466940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741531648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970130.373252:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970130.373318:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741531648 00000100:00100000:2.0:1788970130.373327:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741531648 00000100:00100000:2.0:1788970130.373403:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970130.373414:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f466580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741531648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970130.373453:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970130.373502:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f466580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741531648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970130.373510:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788970130.373544:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970130.373556:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f466940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741531648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788970130.697045:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970130.697933:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970130.698013:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732105984 00000100:00100000:1.0:1788970130.698022:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732105984 00000100:00100000:1.0:1788970130.698079:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 107 00000100:00100000:1.0:1788970130.698090:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:13746:x1875870732105984:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970130.698107:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970130.698127:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f92600/0x5d0de860b05b4f02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed20 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970130.698157:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92600/0x5d0de860b05b4f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed20 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970130.698190:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f92600/0x5d0de860b05b4f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed20 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970130.698199:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92600, rc 0) 00000100:00100000:1.0:1788970130.698258:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13746:x1875870732105984:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 170us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970130.698265:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 107 00000100:00100000:0.0:1788970130.705393:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970130.708929:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732106112 00000100:00100000:3.0:1788970130.708947:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732106112 00000100:00100000:3.0:1788970130.709025:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 108 00000100:00100000:3.0:1788970130.709036:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13746:x1875870732106112:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970130.709336:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13746:x1875870732106112:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 301us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970130.709344:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 108 00000100:00100000:2.0:1788970130.711550:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970130.711625:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732106240 00000100:00100000:3.0:1788970130.711634:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732106240 00000100:00100000:3.0:1788970130.711697:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:3.0:1788970130.711707:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13746:x1875870732106240:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970130.713228:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13746:x1875870732106240:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 1515us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970130.713240:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 109 00000100:00100000:3.0:1788970130.733428:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970130.733619:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732106368 00000100:00100000:2.0:1788970130.733630:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732106368 00000100:00100000:2.0:1788970130.733694:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00100000:2.0:1788970130.733704:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:13746:x1875870732106368:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970130.733722:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970130.733753:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4f09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed27 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970130.733813:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4f09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed27 expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970130.733828:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4f09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed27 expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970130.733838:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44ca00, rc 0) 00000100:00100000:2.0:1788970130.733895:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13746:x1875870732106368:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 192us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970130.733902:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 110 00000100:00100000:3.0:1788970130.736008:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970130.736115:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732106496 00000100:00100000:2.0:1788970130.736125:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732106496 00000100:00100000:2.0:1788970130.736181:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 111 00000100:00100000:2.0:1788970130.736191:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13746:x1875870732106496:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970130.736495:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13746:x1875870732106496:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 305us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970130.736503:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 111 00000100:00100000:2.0:1788970130.738598:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970130.738692:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732106624 00000100:00100000:3.0:1788970130.738701:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732106624 00000100:00100000:3.0:1788970130.738769:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 112 00000100:00100000:3.0:1788970130.738781:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13746:x1875870732106624:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970130.739025:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:13746:x1875870732106624:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 247us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970130.739033:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 112 10000000:01000000:1.0:1788970131.019017:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788970131.019025:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97786df72000 from 10 10000000:01000000:1.0:1788970131.019031:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970131.019084:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970131.019099:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970131.019115:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970131.019143:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741531776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970131.019229:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970131.019284:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970131.019360:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741531776 00000100:00100000:3.0:1788970131.019372:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741531776 00000100:00100000:3.0:1788970131.019435:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788970131.019449:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+16:14385:x1875870741531776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970131.019468:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970131.019482:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a9000/0x5d0de860b05b4f17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4f10 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970131.019510:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9000/0x5d0de860b05b4f17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4f10 expref: 17 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970131.019523:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a9000/0x5d0de860b05b4f17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4f10 expref: 17 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970131.019532:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9000, rc 0) 00000100:00100000:3.0:1788970131.019580:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+17:14385:x1875870741531776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970131.019586:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788970131.019671:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741531776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970131.019688:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970131.019699:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970131.019772:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741531904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970131.019825:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970131.019848:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970131.020010:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741531904 00000100:00100000:3.0:1788970131.020015:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741531904 00000100:00100000:3.0:1788970131.020048:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788970131.020056:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+17:14385:x1875870741531904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970131.020350:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+17:14385:x1875870741531904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970131.020358:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788970131.020432:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741531904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970131.020463:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977878938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970131.020502:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970131.020529:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970131.020570:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741532032 00000100:00100000:3.0:1788970131.020575:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741532032 00000100:00100000:3.0:1788970131.020605:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788970131.020611:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+17:14385:x1875870741532032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970131.020771:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+17:14385:x1875870741532032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970131.020778:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788970131.020883:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977878938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788970131.021856:0:16576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788970131.022149:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788970131.022180:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970131.022190:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.022200:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970131.022209:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788970131.022211:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787f5e8000 from 10 10000000:01000000:0.0:1788970131.022214:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970131.022244:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.022251:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.022261:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970131.022281:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.022329:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970131.022369:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970131.022474:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741532160 00000100:00100000:3.0:1788970131.022481:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741532160 00000100:00100000:3.0:1788970131.022526:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788970131.022535:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+17:14385:x1875870741532160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970131.022548:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970131.022559:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778414a9600/0x5d0de860b05b4f25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4f1e expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970131.022580:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778414a9600/0x5d0de860b05b4f25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4f1e expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970131.022589:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778414a9600/0x5d0de860b05b4f25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4f1e expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970131.022597:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9600, rc 0) 00000100:00100000:3.0:1788970131.022642:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+18:14385:x1875870741532160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970131.022664:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788970131.023223:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970131.023239:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.023247:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970131.023321:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.023355:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970131.023392:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970131.023440:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741532288 00000100:00100000:3.0:1788970131.023444:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741532288 00000100:00100000:3.0:1788970131.023479:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788970131.023486:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977846209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+18:14385:x1875870741532288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970131.023729:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977846209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+18:14385:x1875870741532288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970131.023737:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788970131.023878:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.023920:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.023957:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970131.023975:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970131.023988:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741532416 00000100:00100000:0.0:1788970131.023991:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741532416 00000100:00100000:0.0:1788970131.024019:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788970131.024026:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784620a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+18:14385:x1875870741532416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.024176:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784620a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+18:14385:x1875870741532416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970131.024183:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788970131.024218:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788970131.024874:0:16577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788970131.024924:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788970131.024940:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970131.024948:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.024958:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970131.024979:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788970131.024982:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787a5ba000 from 10 10000000:01000000:0.0:1788970131.024985:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970131.025009:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.025017:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.025027:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970131.025042:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.025074:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970131.025090:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970131.025102:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741532544 00000100:00100000:0.0:1788970131.025107:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741532544 00000100:00100000:0.0:1788970131.025126:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788970131.025133:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977846208050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+18:14385:x1875870741532544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970131.025142:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970131.025153:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4f33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b4f2c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.025185:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b4f2c expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.025195:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b4f2c expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.025215:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4c00, rc 0) 00000100:00100000:0.0:1788970131.025245:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977846208050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:14385:x1875870741532544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970131.025251:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788970131.025281:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970131.025293:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.025301:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970131.025337:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.025360:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970131.025372:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970131.025382:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741532672 00000100:00100000:0.0:1788970131.025385:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741532672 00000100:00100000:0.0:1788970131.025400:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788970131.025405:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784620bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:14385:x1875870741532672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.025601:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784620bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:14385:x1875870741532672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970131.025608:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788970131.025635:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.025659:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.025694:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970131.025712:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970131.025723:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741532800 00000100:00100000:0.0:1788970131.025727:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741532800 00000100:00100000:0.0:1788970131.025744:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788970131.025749:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784620b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:14385:x1875870741532800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970131.025890:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784620b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:14385:x1875870741532800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970131.025897:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788970131.025931:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de37645b-91a3-4bf2-a071-03e750936262:14385:1875870741532800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788970131.028870:0:16578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788970131.029115:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788970131.029138:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970131.029149:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970131.029161:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970131.522064:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970131.522109:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970131.522136:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970131.522183:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970131.522205:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970131.522224:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970131.522250:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970131.522286:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732107136 00000100:00100000:2.0:1788970131.522298:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732107136 00000100:00100000:2.0:1788970131.522350:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732107392 00000100:00100000:2.0:1788970131.522354:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732107392 00000100:00100000:2.0:1788970131.522368:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732107008 00000100:00100000:2.0:1788970131.522370:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732107008 00000100:00100000:2.0:1788970131.522385:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732107520 00000100:00100000:2.0:1788970131.522387:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732107520 00000100:00100000:2.0:1788970131.522404:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788970131.522415:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2355:x1875870732107136:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970131.522494:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2355:x1875870732107136:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 81us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970131.522503:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1788970131.522611:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:0.0:1788970131.522622:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865086940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2355:x1875870732107392:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970131.522654:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865086940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2355:x1875870732107392:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 35us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970131.522674:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:0.0:1788970131.522694:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:0.0:1788970131.522701:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2355:x1875870732107008:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970131.522741:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2355:x1875870732107008:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 40us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970131.522773:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:0.0:1788970131.522804:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:0.0:1788970131.522811:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2355:x1875870732107520:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970131.522837:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2355:x1875870732107520:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 27us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970131.522843:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:2.0:1788970131.523173:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732106752 00000100:00100000:2.0:1788970131.523179:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732106752 00000100:00100000:2.0:1788970131.523212:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:2.0:1788970131.523219:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2355:x1875870732106752:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970131.523248:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2355:x1875870732106752:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 30us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970131.523255:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 122 00000100:00100000:2.0:1788970131.523289:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732106880 00000100:00100000:2.0:1788970131.523301:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732106880 00000100:00100000:2.0:1788970131.523346:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732107264 00000100:00100000:2.0:1788970131.523350:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732107264 00000100:00100000:2.0:1788970131.523375:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:2.0:1788970131.523382:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f4652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2355:x1875870732106880:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970131.523413:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f4652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2355:x1875870732106880:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 31us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970131.523419:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:2.0:1788970131.523431:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:2.0:1788970131.523438:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2355:x1875870732107264:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970131.523464:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2355:x1875870732107264:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 26us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970131.523469:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00080000:2.0:1788970131.523490:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970131.523495:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970131.523498:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788970131.719036:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970131.987360:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788970132.742807:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970133.445320:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741532928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970133.445394:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970133.445530:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741532928 00000100:00100000:0.0:1788970133.445539:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741532928 00000100:00100000:0.0:1788970133.445606:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970133.445615:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741532928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970133.445652:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970133.445704:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741532928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970133.445722:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970133.445772:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741532928:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788970133.445858:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970133.446819:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741533184:0@lo:400:kworker.0 00000100:00100000:0.0:1788970133.446819:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741533440:0@lo:400:kworker.0 00000100:00100000:1.0:1788970133.448659:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741533056:0@lo:400:kworker.0 00000100:00100000:3.0:1788970133.449253:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741533312:0@lo:400:kworker.0 00000100:00100000:2.0:1788970133.458319:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970133.460578:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970133.469270:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970133.469345:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741533056 00000100:00100000:1.0:1788970133.469355:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741533056 00000100:00100000:1.0:1788970133.469407:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788970133.469417:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:3283:x1875870741533056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970133.469584:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741533184 00000100:00100000:0.0:1788970133.469591:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741533184 00000100:00100000:0.0:1788970133.469651:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970133.469660:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865087c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741533184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970133.470243:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865087c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741533184:12345-0@lo:400:kworker.0 Request processed in 582us (11928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970133.470251:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970133.470319:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741533184:0@lo:400:kworker.0 00000100:00100000:0.0:1788970133.470382:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741533568:0@lo:400:kworker.0 00000100:00100000:0.0:1788970133.470423:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970133.470549:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741533440 00000100:00100000:0.0:1788970133.470556:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741533440 00000100:00100000:0.0:1788970133.470587:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741533568 00000100:00100000:0.0:1788970133.470591:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741533568 00000100:00100000:0.0:1788970133.470613:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970133.470620:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741533440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970133.470955:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741533440:12345-0@lo:400:kworker.0 Request processed in 335us (10385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970133.470962:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970133.470977:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788970133.470983:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741533568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970133.471016:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741533568:12345-0@lo:400:kworker.0 Request processed in 34us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970133.471022:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788970133.471038:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970133.471043:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970133.471067:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741533440:0@lo:400:kworker.0 00000100:00100000:0.0:1788970133.471093:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741533568:0@lo:400:kworker.0 00000100:00100000:1.0:1788970133.471331:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:3283:x1875870741533056:12345-0@lo:400:kworker.0 Request processed in 1915us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970133.471340:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788970133.475342:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741533056:0@lo:400:kworker.0 00000100:00100000:3.0:1788970133.476041:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970133.477371:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741533312 00000100:00100000:1.0:1788970133.477385:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741533312 00000100:00100000:1.0:1788970133.477475:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970133.477487:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741533312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970133.477611:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741533312:12345-0@lo:400:kworker.0 Request processed in 127us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970133.477619:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970133.478186:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741533312:0@lo:400:kworker.0 00010000:00010000:3.0:1788970133.766278:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970133.927152:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970133.927377:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732107648 00000100:00100000:2.0:1788970133.927394:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732107648 00000100:00100000:2.0:1788970133.927631:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788970133.927654:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:14401:x1875870732107648:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970133.927682:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970133.927714:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4f3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed2e expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.927867:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.927885:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.927900:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.927934:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.927942:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.927950:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928577:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4f4f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928589:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4f4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928596:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4f4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970133.928625:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788970133.928629:0:14388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970133.928673:0:14388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4f4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928698:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928705:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928713:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928719:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44de00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970133.928724:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928733:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928746:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672c00) 00010000:00010000:2.0:1788970133.928749:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970133.928755:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928761:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928774:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928781:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928787:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928847:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970133.928850:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928858:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928866:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff977851ac1200) 00010000:00010000:2.0:1788970133.928869:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970133.928872:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928878:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4f48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928921:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4f3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed2e expref: 8 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928936:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4f4f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed2e expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970133.928944:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff977851ac1f00) 00010000:00010000:2.0:1788970133.928946:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970133.928948:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44c000, rc 0) 00000100:00100000:2.0:1788970133.929034:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:14401:x1875870732107648:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1393us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970133.929043:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00080000:0.0:1788970133.930135:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970133.948580:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970133.948746:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732107904 00000100:00100000:1.0:1788970133.948760:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732107904 00000100:00100000:1.0:1788970133.948876:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1788970133.948888:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:14401:x1875870732107904:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970133.948915:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970133.949456:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4f56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed35 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.949624:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.949642:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.949658:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.949678:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.949685:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.949692:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.950629:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b4f6b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.950651:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b4f6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.950661:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b4f6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970133.950674:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788970133.951681:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951695:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951703:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951711:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970133.951716:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951725:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951741:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff977851ac1f00) 00010000:00010000:1.0:1788970133.951745:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970133.951751:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951758:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b4f5d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951775:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951872:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951879:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951884:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970133.951887:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951894:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951903:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9778519ab800) 00010000:00010000:1.0:1788970133.951906:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970133.951910:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.951916:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b4f64 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.954034:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4f56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed35 expref: 10 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.954067:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b4f6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed35 expref: 9 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970133.954076:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab500) 00010000:00010000:1.0:1788970133.954079:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970133.954091:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92a00, rc 0) 00000100:00100000:1.0:1788970133.954354:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:14401:x1875870732107904:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 5465us (5901us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788970133.954365:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:2.0:1788970133.960341:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970133.965015:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732108032 00000100:00100000:3.0:1788970133.965036:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732108032 00000100:00100000:3.0:1788970133.965134:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:3.0:1788970133.965158:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:14401:x1875870732108032:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788970133.965307:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:14401:x1875870732108032:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 Request processed in 153us (4983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970133.965316:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000040:00080000:2.0:1788970134.022593:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788970134.065722:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970134.066100:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732108160 00000100:00100000:0.0:1788970134.066111:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732108160 00000100:00100000:0.0:1788970134.066190:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1788970134.066214:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:14407:x1875870732108160:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970134.066237:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970134.066258:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4000/0x5d0de860b05b4f79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed3c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066325:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066339:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066353:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066370:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066378:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066385:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066574:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066583:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066590:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066606:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970134.066611:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066619:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066631:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672c00) 00010000:00010000:0.0:1788970134.066635:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970134.066712:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066719:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b4f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066733:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.066739:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.067187:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.067196:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970134.067199:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.067207:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.067228:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff977849672000) 00010000:00010000:0.0:1788970134.067231:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970134.067234:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.067240:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b4f87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.067277:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4000/0x5d0de860b05b4f79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed3c expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.067287:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672c00) 00010000:00010000:0.0:1788970134.067289:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970134.067293:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4000/0x5d0de860b05b4f79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed3c expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.067308:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4000, rc 0) 00000100:00100000:0.0:1788970134.067368:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:14407:x1875870732108160:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1156us (1666us total) trans 0 rc 301/301 00000100:00100000:0.0:1788970134.067376:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1788970134.084345:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970134.084493:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732108288 00000100:00100000:0.0:1788970134.084505:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732108288 00000100:00100000:0.0:1788970134.084563:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1788970134.084573:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:14407:x1875870732108288:12345-192.168.202.9@tcp:700:lfs.0 00000100:00100000:0.0:1788970134.084666:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:14407:x1875870732108288:12345-192.168.202.9@tcp:700:lfs.0 Request processed in 94us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970134.084674:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1788970134.092395:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.092527:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732108544 00000100:00100000:2.0:1788970134.092538:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732108544 00000100:00100000:2.0:1788970134.092605:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:2.0:1788970134.092615:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:14407:x1875870732108544:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:2.0:1788970134.092686:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970134.093080:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b4ebc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecb7 expref: 9 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.093106:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672c00) 00010000:00010000:2.0:1788970134.093112:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970134.093347:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.093362:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed19 expref: 5 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.093371:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.093404:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed19 expref: 5 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.093421:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed19 expref: 5 pid: 16264 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970134.093435:0:14388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865086580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875870741533696:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970134.093536:0:14388:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778785b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970134.098952:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970134.099037:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732108672 00000100:00100000:0.0:1788970134.099047:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732108672 00010000:00010000:0.0:1788970134.099110:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed19 expref: 6 pid: 16264 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970134.099160:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:0.0:1788970134.099170:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2354:x1875870732108672:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970134.099185:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970134.099194:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed19 expref: 6 pid: 16264 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.099208:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed19 expref: 6 pid: 16264 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.099232:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672c00) 00010000:00010000:0.0:1788970134.099236:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.099246:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.099253:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970134.099272:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970134.099323:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2354:x1875870732108672:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 155us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970134.099330:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00080000:1.0:1788970134.099541:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788970134.100163:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b4ef4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed19 expref: 5 pid: 16264 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970134.100191:0:14388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865086580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875870741533696:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970134.100211:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.100220:0:14388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.100226:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.100250:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.100260:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.100271:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970134.107679:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788970134.107699:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.107720:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.107728:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.107734:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44de00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970134.107739:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.107754:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.107772:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977849672c00) 00010000:00010000:2.0:1788970134.107776:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970134.107780:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.107786:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f8e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970134.107834:0:14388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fddef48 reply state 0000000002aeb47f transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970134.107844:0:14388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970134.107956:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+10:14407:x1875870732108544:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 15337us (15567us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788970134.107980:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00010000:00010000:3.0:1788970134.115282:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.115301:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.115309:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.115332:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970134.115337:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.115345:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.115364:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff977858b3ce00) 00010000:00010000:3.0:1788970134.115367:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970134.115373:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.115379:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4f95 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970134.230318:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.230424:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732108800 00000100:00100000:2.0:1788970134.230434:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732108800 00000100:00100000:2.0:1788970134.230501:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1788970134.230511:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:14415:x1875870732108800:12345-192.168.202.9@tcp:101:lctl.0 00010000:00010000:2.0:1788970134.230536:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970134.230563:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed43 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.230636:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4fa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.230651:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.230663:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970134.230699:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788970134.230702:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970134.230740:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.230779:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed43 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.230820:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed43 expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.230847:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:2.0:1788970134.230850:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970134.230855:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f44d000, rc 0) 00000100:00100000:2.0:1788970134.230931:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+10:14415:x1875870732108800:12345-192.168.202.9@tcp:101:lctl.0 Request processed in 421us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970134.230939:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1788970134.285306:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970134.285451:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732108928 00000100:00100000:3.0:1788970134.285461:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732108928 00000100:00100000:3.0:1788970134.285520:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:3.0:1788970134.285531:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:14416:x1875870732108928:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970134.285554:0:16264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970134.285579:0:16264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4faa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed4a expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.285652:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9200/0x5d0de860b05b4fb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.285666:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9200/0x5d0de860b05b4fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.285692:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9200/0x5d0de860b05b4fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970134.285727:0:16264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788970134.285731:0:16264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970134.285995:0:16264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9200/0x5d0de860b05b4fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.286022:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4faa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed4a expref: 7 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.286041:0:16264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9200/0x5d0de860b05b4fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed4a expref: 6 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.286049:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:3.0:1788970134.286051:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970134.286055:0:16264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a9200, rc 0) 00000100:00100000:3.0:1788970134.286163:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865085e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:14416:x1875870732108928:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 634us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970134.286170:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:0.0:1788970134.296559:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.299887:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732109056 00000100:00100000:2.0:1788970134.299903:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732109056 00000100:00100000:2.0:1788970134.300050:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:2.0:1788970134.300061:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:14416:x1875870732109056:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970134.300082:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970134.300104:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4fb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed51 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300205:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300220:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300231:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300246:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300253:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300275:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300369:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031600/0x5d0de860b05b4fcd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300377:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031600/0x5d0de860b05b4fcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300385:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031600/0x5d0de860b05b4fcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970134.300416:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788970134.300420:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970134.300437:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977840031600/0x5d0de860b05b4fcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300449:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300455:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300462:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300468:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44ce00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970134.300472:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300479:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300498:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:2.0:1788970134.300502:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970134.300508:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300514:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44ce00/0x5d0de860b05b4fbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300527:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300533:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300538:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300543:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44d600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970134.300546:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300552:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300559:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff977851ac1400) 00010000:00010000:2.0:1788970134.300561:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970134.300563:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300569:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d600/0x5d0de860b05b4fc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300607:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44de00/0x5d0de860b05b4fb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed51 expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300619:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031600/0x5d0de860b05b4fcd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed51 expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.300625:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff977851ac1700) 00010000:00010000:2.0:1788970134.300627:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970134.300629:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031600, rc 0) 00000100:00100000:2.0:1788970134.300720:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+7:14416:x1875870732109056:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 661us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970134.300727:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:0.0:1788970134.316003:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.318059:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732109312 00000100:00100000:2.0:1788970134.318075:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732109312 00000100:00100000:2.0:1788970134.318200:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:2.0:1788970134.318211:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+7:14416:x1875870732109312:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970134.318234:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970134.318257:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b4fd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed58 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970134.318349:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788970134.318470:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b4fd4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed58 expref: 9 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.318484:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:2.0:1788970134.318487:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970134.318507:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b4fd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed58 expref: 9 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.318520:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030c00, rc 0) 00000100:00100000:2.0:1788970134.318586:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+8:14416:x1875870732109312:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 378us (2597us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788970134.318594:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:0.0:1788970134.326404:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970134.326487:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732109568 00000100:00100000:1.0:1788970134.326496:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732109568 00000100:00100000:1.0:1788970134.326557:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:1.0:1788970134.326568:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+8:14416:x1875870732109568:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:1.0:1788970134.326626:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970134.326665:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031600/0x5d0de860b05b4fcd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed51 expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.326684:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff977851ac1700) 00010000:00010000:1.0:1788970134.326695:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970134.326728:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.326741:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.326766:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970134.327009:0:14389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de028536 reply state 00000000a06bc912 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970134.327020:0:14389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788970134.327028:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788970134.327114:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+9:14416:x1875870732109568:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 547us (721us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788970134.327144:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:0.0:1788970134.333258:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1788970134.333356:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.333369:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.333378:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.333384:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970134.333389:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.333397:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.333414:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970134.333417:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788970134.333422:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.333428:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b4fe2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970134.333497:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732109824 00000100:00100000:2.0:1788970134.333507:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732109824 00000100:00100000:2.0:1788970134.333558:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:2.0:1788970134.333569:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+8:14416:x1875870732109824:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970134.333824:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+9:14416:x1875870732109824:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 257us (576us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788970134.333833:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:0.0:1788970134.341599:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970134.344871:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732110080 00000100:00100000:3.0:1788970134.344886:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732110080 00000100:00100000:3.0:1788970134.344955:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:3.0:1788970134.344966:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+9:14416:x1875870732110080:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970134.344990:0:16264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970134.345011:0:16264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed5f expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345101:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345116:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345127:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345151:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345158:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345165:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970134.345278:0:16264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788970134.345366:0:16264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345375:0:16264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345381:0:16264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345387:0:16264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970134.345392:0:16264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345411:0:16264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345423:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:3.0:1788970134.345426:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970134.345431:0:16264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345437:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b4ff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345451:0:16264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345457:0:16264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345463:0:16264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345468:0:16264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970134.345471:0:16264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345477:0:16264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345484:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff977858b3ce00) 00010000:00010000:3.0:1788970134.345486:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970134.345489:0:16264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345506:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b4ff7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345546:0:16264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4fe9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed5f expref: 11 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345557:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:3.0:1788970134.345559:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970134.345563:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b4fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed5f expref: 11 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.345572:0:16264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8200, rc 0) 00000100:00100000:3.0:1788970134.345631:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+10:14416:x1875870732110080:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 667us (4042us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788970134.346685:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:0.0:1788970134.351837:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970134.352058:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732110208 00000100:00100000:1.0:1788970134.352067:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732110208 00000100:00100000:1.0:1788970134.352125:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:1.0:1788970134.352145:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+10:14416:x1875870732110208:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:1.0:1788970134.352169:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970134.352206:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b5005 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed66 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.352299:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.352313:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.352325:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970134.352350:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788970134.352353:0:14389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970134.352371:0:14389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.352395:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b5005 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed66 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.352413:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed66 expref: 11 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.352421:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970134.352424:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970134.352427:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92200, rc 0) 00000100:00100000:1.0:1788970134.352489:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+11:14416:x1875870732110208:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 355us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970134.352497:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:0.0:1788970134.369158:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.369264:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732110336 00000100:00100000:2.0:1788970134.369274:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732110336 00000100:00100000:2.0:1788970134.369332:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:2.0:1788970134.369344:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+11:14416:x1875870732110336:12345-192.168.202.9@tcp:37:lfs.0 00000100:00100000:2.0:1788970134.376147:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+11:14416:x1875870732110336:12345-192.168.202.9@tcp:37:lfs.0 Request processed in 6782us (6987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970134.376162:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:0.0:1788970134.391242:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970134.391339:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732110592 00000100:00100000:3.0:1788970134.391349:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732110592 00000100:00100000:3.0:1788970134.391412:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1788970134.391423:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851fabc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+11:14416:x1875870732110592:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1788970134.391672:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851fabc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+12:14416:x1875870732110592:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 251us (440us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788970134.391679:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1788970134.520979:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.521125:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732110720 00000100:00100000:2.0:1788970134.521166:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732110720 00000100:00100000:2.0:1788970134.521227:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:2.0:1788970134.521239:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+10:14422:x1875870732110720:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970134.521260:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970134.521294:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b5013 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed6d expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521360:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521374:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521385:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521415:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521423:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521429:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521526:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5028 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521534:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5028 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521541:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5028 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970134.521571:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788970134.521574:0:14388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970134.521611:0:14388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5028 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521631:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521638:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521645:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521651:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970134.521655:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521662:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521674:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:2.0:1788970134.521677:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970134.521682:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521688:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b501a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521711:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521717:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521722:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521733:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970134.521736:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521742:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.521751:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff977851ac1400) 00010000:00010000:2.0:1788970134.521753:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970134.521998:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.522009:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b5021 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.522042:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b5013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed6d expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.522056:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5028 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed6d expref: 11 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.522063:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970134.522065:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788970134.522069:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030800, rc 0) 00000100:00100000:2.0:1788970134.522125:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:14422:x1875870732110720:12345-192.168.202.9@tcp:101:bash.0 Request processed in 889us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970134.522144:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:0.0:1788970134.526072:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.526180:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732110976 00000100:00100000:2.0:1788970134.526205:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732110976 00000100:00100000:2.0:1788970134.526265:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:2.0:1788970134.526275:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:14422:x1875870732110976:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970134.526295:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970134.526314:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b502f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed74 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.526601:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.526618:0:14389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed66 expref: 11 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.526628:0:14389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.526671:0:14389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed66 expref: 11 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.526687:0:14389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed66 expref: 11 pid: 14389 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970134.526700:0:14389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14389:1875870741533824:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970134.526818:0:14389:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778785b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970134.533324:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970134.533417:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732111104 00000100:00100000:3.0:1788970134.533427:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732111104 00010000:00010000:3.0:1788970134.533469:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed66 expref: 12 pid: 14389 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970134.533529:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1788970134.533539:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+12:2354:x1875870732111104:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970134.533555:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970134.533562:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed66 expref: 12 pid: 14389 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.533576:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed66 expref: 12 pid: 14389 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.533597:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:3.0:1788970134.533603:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.533613:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.533622:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.533650:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970134.533714:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed26fada-f3c3-4d29-9040-b6cb88c25b67+12:2354:x1875870732111104:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 176us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970134.533722:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00010000:00010000:2.0:1788970134.534736:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b500c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed66 expref: 11 pid: 14389 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970134.534756:0:14389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14389:1875870741533824:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970134.534825:0:14389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.534834:0:14389:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.534840:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.535032:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.535045:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.535056:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.535847:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.535860:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.538851:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970134.539005:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970134.539065:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.539074:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.539101:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.539107:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970134.539111:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.539119:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.539145:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970134.539149:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970134.539154:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.539161:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5036 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970134.539175:0:14389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a936fb2b reply state 000000001f0ebad4 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970134.539184:0:14389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788970134.539238:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b502f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed74 expref: 14 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.539255:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed74 expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.539262:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970134.539264:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788970134.539274:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030200, rc 0) 00000100:00100000:2.0:1788970134.539420:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+14:14422:x1875870732110976:12345-192.168.202.9@tcp:101:bash.0 Request processed in 13145us (13356us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788970134.539428:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 28 00010000:00010000:3.0:1788970134.554766:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.554821:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.554846:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.554852:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970134.554856:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.554864:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.554881:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff977851ac1a00) 00010000:00010000:3.0:1788970134.554884:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970134.554889:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970134.554894:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b503d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970134.569728:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.569877:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732111232 00000100:00100000:2.0:1788970134.569887:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732111232 00000100:00100000:2.0:1788970134.569948:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:2.0:1788970134.569958:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878938780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+13:14422:x1875870732111232:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970134.569981:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970134.570001:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5052 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed7b expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.570065:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5059 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.570080:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.570091:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970134.570142:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788970134.570147:0:14388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970134.570169:0:14388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.570180:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.570210:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5052 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed7b expref: 15 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.570244:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5059 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed7b expref: 14 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.570252:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970134.570256:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970134.570259:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030e00, rc 0) 00000100:00100000:2.0:1788970134.570328:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878938780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+14:14422:x1875870732111232:12345-192.168.202.9@tcp:101:bash.0 Request processed in 371us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970134.570335:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:0.0:1788970134.578521:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970134.578614:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732111488 00000100:00100000:3.0:1788970134.578624:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732111488 00000100:00100000:3.0:1788970134.578694:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:3.0:1788970134.578712:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+14:14422:x1875870732111488:12345-192.168.202.9@tcp:35:bash.0 00000001:00080000:3.0:1788970134.579053:0:14391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:3.0:1788970134.579281:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+16:14422:x1875870732111488:12345-192.168.202.9@tcp:35:bash.0 Request processed in 571us (768us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788970134.579290:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000020:00080000:3.0:1788970134.579295:0:14391:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788970134.739319:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.739458:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732111744 00000100:00100000:2.0:1788970134.739467:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732111744 00000100:00100000:2.0:1788970134.739598:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:2.0:1788970134.739611:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+16:14432:x1875870732111744:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970134.739646:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970134.739667:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed82 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970134.739780:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788970134.739939:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5060 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed82 expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.739952:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:2.0:1788970134.739955:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970134.739959:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed82 expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.739992:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031400, rc 0) 00000100:00100000:2.0:1788970134.740057:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+17:14432:x1875870732111744:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 449us (748us total) trans 8589934603 rc 301/301 00000100:00100000:2.0:1788970134.740063:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:1.0:1788970134.751976:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.752774:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732112000 00000100:00100000:2.0:1788970134.752785:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732112000 00000100:00100000:2.0:1788970134.752928:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:2.0:1788970134.752939:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+17:14432:x1875870732112000:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970134.753206:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+18:14432:x1875870732112000:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 267us (1238us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788970134.753216:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00010000:00010000:1.0:1788970134.789076:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970134.816270:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.816373:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732112256 00000100:00100000:2.0:1788970134.816383:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732112256 00000100:00100000:2.0:1788970134.816442:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:2.0:1788970134.816453:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+18:14435:x1875870732112256:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970134.816478:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970134.816498:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b506e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed89 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.816605:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b5075 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.816632:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b5075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.816648:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b5075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970134.816674:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970134.816895:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b506e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed89 expref: 21 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.816915:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b5075 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed89 expref: 20 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.816923:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970134.816925:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970134.816928:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030c00, rc 0) 00000100:00100000:2.0:1788970134.816991:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+20:14435:x1875870732112256:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 540us (732us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788970134.816998:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:0.0:1788970134.827897:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970134.827949:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970134.828088:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732112512 00000100:00100000:2.0:1788970134.828099:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732112512 00000100:00100000:2.0:1788970134.828183:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:2.0:1788970134.828194:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+20:2354:x1875870732112512:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970134.828211:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970134.828248:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b5075 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed89 expref: 20 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970134.828268:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970134.828273:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970134.828332:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+19:2354:x1875870732112512:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 140us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970134.828339:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:1.0:1788970134.828441:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732112384 00000100:00100000:1.0:1788970134.828446:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732112384 00000100:00100000:1.0:1788970134.828482:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:1.0:1788970134.828489:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+19:14435:x1875870732112384:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:1.0:1788970134.828543:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.828557:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.828567:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.828593:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.828599:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.828605:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.828610:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970134.828615:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.828635:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.828651:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:1.0:1788970134.828660:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970134.828665:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970134.828673:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b5083 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970134.828709:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+19:14435:x1875870732112384:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 221us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970134.828716:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:1.0:1788970134.832930:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970134.833092:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732112768 00000100:00100000:3.0:1788970134.833114:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732112768 00000100:00100000:3.0:1788970134.833183:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:3.0:1788970134.833193:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+19:14435:x1875870732112768:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1788970134.833726:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+20:14435:x1875870732112768:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 532us (804us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788970134.833734:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970135.155865:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970135.155979:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732113024 00000100:00100000:2.0:1788970135.155991:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732113024 00000100:00100000:2.0:1788970135.156075:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:2.0:1788970135.156087:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+20:14466:x1875870732113024:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:2.0:1788970135.156112:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970135.156146:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b508a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed90 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.156252:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5091 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.156283:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5091 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.156298:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5091 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970135.156311:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970135.156458:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b508a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed90 expref: 23 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.156478:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5091 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed90 expref: 22 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.156486:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970135.156489:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970135.156492:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031400, rc 0) 00000100:00100000:2.0:1788970135.156561:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+22:14466:x1875870732113024:12345-192.168.202.9@tcp:101:cat.0 Request processed in 477us (922us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788970135.156586:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00080000:1.0:1788970135.158924:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970135.161715:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970135.161926:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732113280 00000100:00100000:2.0:1788970135.161936:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732113280 00000100:00100000:2.0:1788970135.161993:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788970135.162004:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+22:14466:x1875870732113280:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:2.0:1788970135.162494:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+23:14466:x1875870732113280:12345-192.168.202.9@tcp:35:cat.0 Request processed in 490us (786us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788970135.162502:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:0.0:1788970135.165118:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970135.165548:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732113408 00000100:00100000:2.0:1788970135.165558:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732113408 00000100:00100000:2.0:1788970135.165812:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:2.0:1788970135.165823:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+23:2354:x1875870732113408:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970135.165841:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970135.165868:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5091 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed90 expref: 23 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.165887:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970135.165893:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970135.165953:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+22:2354:x1875870732113408:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 132us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970135.165960:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:0.0:1788970135.281056:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970135.281191:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732113664 00000100:00100000:1.0:1788970135.281201:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732113664 00000100:00100000:1.0:1788970135.281279:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:1.0:1788970135.281288:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+22:14472:x1875870732113664:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:1.0:1788970135.281311:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970135.281328:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b509f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed97 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.281414:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b50a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.281428:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b50a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.281440:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b50a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970135.281450:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788970135.281606:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93e00/0x5d0de860b05b509f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed97 expref: 25 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.281941:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b50a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed97 expref: 24 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.281953:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:1.0:1788970135.281956:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970135.281959:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93600, rc 0) 00000100:00100000:1.0:1788970135.282029:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+24:14472:x1875870732113664:12345-192.168.202.9@tcp:101:dd.0 Request processed in 741us (983us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1788970135.282036:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:0.0:1788970135.292229:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970135.293186:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732113920 00000100:00100000:2.0:1788970135.293199:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732113920 00000100:00100000:2.0:1788970135.293275:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:2.0:1788970135.293285:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+24:14472:x1875870732113920:12345-192.168.202.9@tcp:36:dd.0 00010000:00010000:2.0:1788970135.293367:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788970135.293398:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93600/0x5d0de860b05b50a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed97 expref: 24 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.293424:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5059 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed7b expref: 23 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.293435:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970135.293440:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970135.294332:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.294351:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970135.294363:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970135.294428:0:14388:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:2.0:1788970135.294455:0:14388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e6a11a8 reply state 00000000931c89c1 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970135.294464:0:14388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970135.295304:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+25:14472:x1875870732113920:12345-192.168.202.9@tcp:36:dd.0 Request processed in 2015us (3084us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788970135.295313:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00000020:00080000:2.0:1788970135.295319:0:14388:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788970135.306454:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.306473:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.306493:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.306500:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970135.306505:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.306513:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.306529:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:1.0:1788970135.306533:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970135.306538:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.306560:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b50b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970135.494346:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970135.494372:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741533952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970135.494454:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970135.494678:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741533952 00000100:00100000:2.0:1788970135.494696:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741533952 00000100:00100000:2.0:1788970135.494764:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970135.494809:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741533952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970135.494851:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970135.494911:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741533952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970135.494917:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788970135.495698:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970135.495745:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741533952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970135.518899:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970135.521658:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732114176 00000100:00100000:3.0:1788970135.521678:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732114176 00000100:00100000:3.0:1788970135.521775:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:3.0:1788970135.521814:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+24:14472:x1875870732114176:12345-192.168.202.9@tcp:35:dd.0 00000100:00100000:3.0:1788970135.522639:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+25:14472:x1875870732114176:12345-192.168.202.9@tcp:35:dd.0 Request processed in 851us (3747us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788970135.522655:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00010000:00010000:3.0:1788970135.813723:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970135.849327:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970135.849565:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732114304 00000100:00100000:1.0:1788970135.849579:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732114304 00000100:00100000:1.0:1788970135.849701:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:1.0:1788970135.849713:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+25:14486:x1875870732114304:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:1.0:1788970135.849746:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970135.849784:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b50bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ed9e expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.849919:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.849937:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.849952:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.849968:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.849974:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.849998:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.850116:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b50d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.850133:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b50d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.850141:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b50d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970135.850195:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788970135.850200:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970135.850727:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b50d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.850745:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b50d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.850755:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.850762:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.850780:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.850787:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970135.852843:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.852884:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.852908:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970135.852911:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970135.852917:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.852924:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b50c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.852950:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.852957:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.852965:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.852971:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970135.852974:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.852980:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.852986:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9778519abd00) 00010000:00010000:1.0:1788970135.852989:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970135.852992:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.853007:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b50c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.853074:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b50bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed9e expref: 27 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.853103:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b50d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed9e expref: 26 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.853111:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:1.0:1788970135.853114:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970135.853117:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93000, rc 0) 00000100:00100000:1.0:1788970135.853234:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+26:14486:x1875870732114304:12345-192.168.202.9@tcp:101:stat.0 Request processed in 3521us (3921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970135.853243:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:1.0:1788970135.952626:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970135.952887:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732114560 00000100:00100000:3.0:1788970135.952901:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732114560 00000100:00100000:3.0:1788970135.952987:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:3.0:1788970135.952999:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878939e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+26:14492:x1875870732114560:12345-192.168.202.9@tcp:36:truncate.0 00010000:00010000:3.0:1788970135.953073:0:16264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970135.953107:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93000/0x5d0de860b05b50d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed9e expref: 26 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970135.953141:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:3.0:1788970135.953147:0:16264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970135.954179:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970135.954241:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970135.954255:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970135.954314:0:16264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934613 00000004:00010000:3.0:1788970135.954344:0:16264:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b2e3cd9 reply state 000000001d755939 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970135.954355:0:16264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970135.954575:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878939e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+28:14492:x1875870732114560:12345-192.168.202.9@tcp:36:truncate.0 Request processed in 1574us (1962us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788970135.954585:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00000020:00080000:3.0:1788970135.954592:0:16264:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788970135.961301:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.961327:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.961337:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.961345:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970135.961350:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.961383:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.961407:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:1.0:1788970135.961410:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970135.961417:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970135.961425:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b50d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970136.284735:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970136.284865:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732114688 00000100:00100000:2.0:1788970136.284878:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732114688 00000100:00100000:2.0:1788970136.284961:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:2.0:1788970136.284973:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+27:14506:x1875870732114688:12345-192.168.202.9@tcp:101:stat.0 00010000:00010000:2.0:1788970136.285006:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970136.285032:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b50de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eda5 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285128:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285146:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285163:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285180:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285188:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285194:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285329:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285339:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285347:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970136.285394:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788970136.285399:0:14389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970136.285425:0:14389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285439:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285448:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285456:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285464:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285470:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970136.285475:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285484:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285504:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:2.0:1788970136.285507:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970136.285514:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285522:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b50e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285538:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285544:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285550:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285556:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970136.285558:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285564:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285571:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff977851ac1400) 00010000:00010000:2.0:1788970136.285573:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970136.285576:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285582:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b50ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285628:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b50de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eda5 expref: 29 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285643:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eda5 expref: 28 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.285651:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970136.285653:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970136.285656:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030a00, rc 0) 00000100:00100000:2.0:1788970136.290349:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+28:14506:x1875870732114688:12345-192.168.202.9@tcp:101:stat.0 Request processed in 5359us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970136.290366:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:0.0:1788970136.427055:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970136.427173:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732114944 00000100:00100000:2.0:1788970136.427188:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732114944 00000100:00100000:2.0:1788970136.427263:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:2.0:1788970136.427274:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+28:14516:x1875870732114944:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970136.427305:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970136.427332:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b50fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edac expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970136.427473:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788970136.427638:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b50fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edac expref: 30 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.427654:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:2.0:1788970136.427657:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970136.427688:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b50fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edac expref: 30 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.427706:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030e00, rc 0) 00000100:00100000:2.0:1788970136.428150:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+29:14516:x1875870732114944:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 875us (1108us total) trans 8589934615 rc 301/301 00000100:00100000:2.0:1788970136.428163:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:0.0:1788970136.433703:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970136.433833:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732115200 00000100:00100000:2.0:1788970136.433846:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732115200 00000100:00100000:2.0:1788970136.433918:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788970136.433930:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851fa9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+29:14516:x1875870732115200:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970136.434267:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851fa9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+30:14516:x1875870732115200:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 338us (589us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1788970136.434276:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:1.0:1788970136.531313:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970136.531435:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732115456 00000100:00100000:2.0:1788970136.531449:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732115456 00000100:00100000:2.0:1788970136.531525:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:2.0:1788970136.531536:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+30:14522:x1875870732115456:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970136.531582:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970136.531610:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5108 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edb3 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.532183:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.532204:0:14390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed74 expref: 31 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.532240:0:14390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eda5 expref: 31 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.532249:0:14390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.532291:0:14390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eda5 expref: 31 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.532309:0:14390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eda5 expref: 31 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970136.532327:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14390:1875870741534080:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970136.532490:0:14390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed74 expref: 31 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.532501:0:14390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed74 expref: 31 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970136.532511:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14390:1875870741534208:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970136.532534:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788970136.544224:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970136.544261:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970136.544426:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14390:1875870741534080:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970136.544440:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14390:1875870741534208:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970136.544471:0:14390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970136.545071:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732115584 00000100:00100000:1.0:1788970136.545081:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732115584 00010000:00010000:1.0:1788970136.545142:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eda5 expref: 32 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970136.545226:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732115712 00000100:00100000:1.0:1788970136.545230:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732115712 00010000:00010000:1.0:1788970136.545245:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed74 expref: 33 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970136.545381:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1788970136.545393:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977850c06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:2353:x1875870732115584:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970136.545423:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970136.545432:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eda5 expref: 33 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.545448:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eda5 expref: 33 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.545474:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030a00/0x5d0de860b05b50f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eda5 expref: 33 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.545496:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970136.545501:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.545511:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.545518:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970136.545597:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977850c06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+32:2353:x1875870732115584:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 206us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970136.545605:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1788970136.545684:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:2.0:1788970136.545691:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845375680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+31:2353:x1875870732115712:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970136.545699:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970136.545713:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed74 expref: 31 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.545724:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed74 expref: 31 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.545736:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5044 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed74 expref: 31 pid: 14389 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.545746:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970136.545750:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.549120:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.549146:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.549201:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970136.549281:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845375680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+30:2353:x1875870732115712:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3583us (5012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970136.549293:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00010000:00010000:2.0:1788970136.549348:0:14390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.549358:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970136.549383:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788970136.550344:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b5108 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edb3 expref: 31 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.550393:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edb3 expref: 30 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.551881:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970136.551884:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788970136.551889:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031c00, rc 0) 00000100:00100000:2.0:1788970136.551982:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+30:14522:x1875870732115456:12345-192.168.202.9@tcp:101:bash.0 Request processed in 20444us (20681us total) trans 8589934617 rc 0/0 00000100:00100000:2.0:1788970136.551993:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:0.0:1788970136.560908:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970136.561668:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732115968 00000100:00100000:3.0:1788970136.561693:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732115968 00000100:00100000:3.0:1788970136.561776:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:3.0:1788970136.561811:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+30:14522:x1875870732115968:12345-192.168.202.9@tcp:36:bash.0 00010000:00010000:3.0:1788970136.562169:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.562192:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.562206:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970136.562270:0:16264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000004:00010000:3.0:1788970136.562296:0:16264:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db182c66 reply state 00000000904dbee2 transno 8589934619 ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970136.562326:0:16264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970136.562786:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14522:x1875870732115968:12345-192.168.202.9@tcp:36:bash.0 Request processed in 998us (1889us total) trans 8589934619 rc 0/0 00000100:00100000:3.0:1788970136.562819:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00000020:00080000:3.0:1788970136.562827:0:16264:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788970136.567366:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1788970136.568071:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970136.568088:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970136.568097:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970136.568150:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970136.568156:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970136.568166:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970136.568190:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:1.0:1788970136.568193:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970136.568199:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970136.568206:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b511d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970136.568355:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732116096 00000100:00100000:3.0:1788970136.568369:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732116096 00000100:00100000:3.0:1788970136.568454:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:3.0:1788970136.568466:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865084780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+32:14522:x1875870732116096:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1788970136.568499:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970136.568520:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5124 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edba expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.568593:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5124 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edba expref: 33 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.568609:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5124 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edba expref: 33 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.568641:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:3.0:1788970136.568644:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970136.568647:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8e00, rc 0) 00000100:00100000:3.0:1788970136.568958:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865084780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14522:x1875870732116096:12345-192.168.202.9@tcp:101:bash.0 Request processed in 493us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970136.568966:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:0.0:1788970136.574251:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970136.574343:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732116224 00000100:00100000:2.0:1788970136.574357:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732116224 00000100:00100000:2.0:1788970136.574436:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:2.0:1788970136.574447:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778453752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14522:x1875870732116224:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970136.574473:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970136.574500:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b512b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edc1 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.574644:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.574661:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edb3 expref: 34 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.574672:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.574731:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edb3 expref: 34 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.574747:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edb3 expref: 34 pid: 14390 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970136.574764:0:14388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875870741534336:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970136.574900:0:14388:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970136.578576:0:14388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875870741534336:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970136.578630:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970136.580537:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970136.580946:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732116352 00000100:00100000:2.0:1788970136.580959:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732116352 00010000:00010000:2.0:1788970136.581010:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edb3 expref: 35 pid: 14390 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970136.581059:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:2.0:1788970136.581069:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845376d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+35:2353:x1875870732116352:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970136.581090:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970136.581098:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edb3 expref: 35 pid: 14390 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.581125:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edb3 expref: 35 pid: 14390 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.581181:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031c00/0x5d0de860b05b510f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edb3 expref: 35 pid: 14390 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.581203:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:2.0:1788970136.581209:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.581221:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.581229:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970136.581264:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970136.581331:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845376d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+34:2353:x1875870732116352:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 263us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970136.581340:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00010000:00010000:3.0:1788970136.581572:0:14388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.581589:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970136.581664:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788970136.581670:0:14388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970136.581700:0:14388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.581737:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030e00/0x5d0de860b05b512b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc1 expref: 34 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.581756:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc1 expref: 33 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.581979:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:3.0:1788970136.581982:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970136.581986:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030200, rc 0) 00000100:00100000:3.0:1788970136.582024:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778453752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14522:x1875870732116224:12345-192.168.202.9@tcp:101:bash.0 Request processed in 7579us (7787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970136.582031:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:0.0:1788970136.589060:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970136.589156:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732116608 00000100:00100000:3.0:1788970136.589169:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732116608 00000100:00100000:3.0:1788970136.589245:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:3.0:1788970136.589256:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845375e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14522:x1875870732116608:12345-192.168.202.9@tcp:103:bash.0 00010000:00010000:3.0:1788970136.589275:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788970136.589305:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030200/0x5d0de860b05b5132 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc1 expref: 33 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.589358:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5124 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edba expref: 32 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.589373:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977851ac1c00) 00010000:00010000:3.0:1788970136.589385:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970136.589464:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845375e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+31:14522:x1875870732116608:12345-192.168.202.9@tcp:103:bash.0 Request processed in 210us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970136.589472:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:0.0:1788970136.592483:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970136.592640:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732116736 00000100:00100000:3.0:1788970136.592654:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732116736 00000100:00100000:3.0:1788970136.592732:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:3.0:1788970136.592742:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+31:14522:x1875870732116736:12345-192.168.202.9@tcp:58:bash.0 00010000:00010000:3.0:1788970136.592902:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.592922:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.592936:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970136.593783:0:14389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970136.593993:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788970136.594068:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788970136.594217:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+31:14522:x1875870732116736:12345-192.168.202.9@tcp:58:bash.0 Request processed in 1471us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970136.594229:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:0.0:1788970136.599040:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970136.599142:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732116864 00000100:00100000:3.0:1788970136.599155:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732116864 00000100:00100000:3.0:1788970136.599232:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:3.0:1788970136.599243:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+31:14522:x1875870732116864:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1788970136.599271:0:16264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970136.599298:0:16264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5140 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edc8 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.599375:0:16264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.599387:0:16264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5140 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc8 expref: 32 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.599408:0:16264:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.599422:0:16264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5140 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc8 expref: 32 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.599438:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977858b3ce00) 00010000:00010000:3.0:1788970136.599440:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970136.599444:0:16264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5140 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc8 expref: 32 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970136.599452:0:16264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8e00, rc 0) 00000100:00100000:3.0:1788970136.599520:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+32:14522:x1875870732116864:12345-192.168.202.9@tcp:101:bash.0 Request processed in 279us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970136.599526:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:0.0:1788970136.634767:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970136.634923:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970136.634948:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970136.634997:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732117376 00000100:00100000:3.0:1788970136.635011:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732117376 00000100:00100000:3.0:1788970136.635101:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:3.0:1788970136.635127:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+11:2353:x1875870732117376:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970136.635241:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+11:2353:x1875870732117376:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 131us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970136.635250:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:0.0:1788970136.635728:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970136.635753:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00080000:1.0:1788970136.636366:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970136.636421:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732116992 00000100:00100000:1.0:1788970136.636429:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732116992 00000100:00100000:1.0:1788970136.636487:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:1.0:1788970136.636497:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2353:x1875870732116992:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970136.636564:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2353:x1875870732116992:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 68us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970136.636572:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 124 00000100:00100000:2.0:1788970136.636982:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732117120 00000100:00100000:2.0:1788970136.636989:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732117120 00000100:00100000:2.0:1788970136.637030:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732117632 00000100:00100000:2.0:1788970136.637033:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732117632 00000100:00100000:2.0:1788970136.637053:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788970136.637060:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2353:x1875870732117120:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970136.637098:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2353:x1875870732117120:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 40us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970136.637105:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788970136.637132:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:2.0:1788970136.637157:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845377840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2353:x1875870732117632:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970136.637184:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845377840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2353:x1875870732117632:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 28us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970136.637190:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00080000:1.0:1788970136.637253:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970136.637257:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970136.638887:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970136.638995:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732117248 00000100:00100000:2.0:1788970136.639005:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732117248 00000100:00100000:2.0:1788970136.639050:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732117504 00000100:00100000:2.0:1788970136.639053:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732117504 00000100:00100000:2.0:1788970136.639071:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:2.0:1788970136.639079:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778453761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2353:x1875870732117248:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970136.639565:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778453761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2353:x1875870732117248:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 485us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970136.639574:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:2.0:1788970136.639596:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1788970136.639603:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878939680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2353:x1875870732117504:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970136.639640:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878939680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2353:x1875870732117504:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 38us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970136.639646:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00080000:1.0:1788970136.639775:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970136.639781:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788970136.837544:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970137.094454:0:14422:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788970137.094466:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970137.094506:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788970137.094514:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788970137.094682:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977865087840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14422:1875870741534464:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788970137.094840:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970137.111086:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970137.111227:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732117760 00000100:00100000:0.0:1788970137.111240:0:14399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732117760 00000100:00100000:0.0:1788970137.111326:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1788970137.111339:0:14399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14524:x1875870732117760:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788970137.111439:0:14399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14524:x1875870732117760:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 Request processed in 103us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970137.111447:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00080000:1.0:1788970137.111819:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970137.114081:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977865087840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14422:1875870741534464:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788970137.122234:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.122346:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732117888 00000100:00100000:3.0:1788970137.122360:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732117888 00000100:00100000:3.0:1788970137.122474:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:3.0:1788970137.122486:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+32:14524:x1875870732117888:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788970137.122528:0:16264:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788970137.122715:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+32:14524:x1875870732117888:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 231us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970137.122723:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:2.0:1788970137.128763:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.129143:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732118016 00000100:00100000:3.0:1788970137.129156:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732118016 00000100:00100000:3.0:1788970137.129240:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:3.0:1788970137.129251:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865087840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+32:14524:x1875870732118016:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788970137.129351:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129372:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129387:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129437:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129446:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129452:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129477:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129485:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129492:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970137.129538:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788970137.129543:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970137.129560:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129572:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129579:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129586:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129600:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.129605:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129622:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129637:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab500) 00010000:00010000:3.0:1788970137.129640:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970137.129646:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129653:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b5147 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129670:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129675:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129682:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129687:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.129689:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129961:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129981:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff977858b3c700) 00010000:00010000:3.0:1788970137.129984:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970137.129988:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.129994:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b514e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.130014:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.130020:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.130027:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.130032:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.130035:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.130040:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.130048:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977858b3ce00) 00010000:00010000:3.0:1788970137.130050:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970137.130052:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.130058:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5155 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970137.130168:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865087840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+32:14524:x1875870732118016:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 917us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970137.130177:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:1.0:1788970137.137641:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970137.137742:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732118272 00000100:00100000:2.0:1788970137.137754:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732118272 00000100:00100000:2.0:1788970137.137859:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:2.0:1788970137.137873:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778789392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+32:14524:x1875870732118272:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970137.137960:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970137.137991:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4000/0x5d0de860b05b515c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edcf expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138138:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138155:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138168:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970137.138198:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788970137.138326:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138334:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138341:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138348:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970137.138353:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138362:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138376:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977858b3ce00) 00010000:00010000:0.0:1788970137.138381:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970137.138388:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138394:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5163 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138445:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4000/0x5d0de860b05b515c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edcf expref: 34 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138456:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab500) 00010000:00010000:0.0:1788970137.138458:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970137.138468:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4000/0x5d0de860b05b515c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edcf expref: 34 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.138486:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4000, rc 0) 00000100:00100000:0.0:1788970137.138572:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778789392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14524:x1875870732118272:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 702us (943us total) trans 8589934620 rc 301/301 00000100:00100000:0.0:1788970137.138580:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:2.0:1788970137.141323:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970137.141396:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732118400 00000100:00100000:1.0:1788970137.141409:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732118400 00000100:00100000:1.0:1788970137.141470:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:1.0:1788970137.141481:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14524:x1875870732118400:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788970137.141526:0:14389:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788970137.141820:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14524:x1875870732118400:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 340us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970137.141829:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:2.0:1788970137.148407:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.149103:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732118656 00000100:00100000:3.0:1788970137.149127:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732118656 00000100:00100000:3.0:1788970137.149250:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:3.0:1788970137.149261:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865086d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+33:14524:x1875870732118656:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970137.149287:0:16264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970137.149314:0:16264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5171 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edd6 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970137.153136:0:16264:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1788970137.153152:0:16264:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788970137.153217:0:16264:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788970137.153562:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b5178 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.153583:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b5178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.153598:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b5178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.154220:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5171 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edd6 expref: 36 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.154246:0:16264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b5178 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edd6 expref: 35 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.154256:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970137.154260:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970137.154264:0:16264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031a00, rc 0) 00000100:00100000:2.0:1788970137.154362:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865086d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+35:14524:x1875870732118656:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 5102us (5971us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788970137.154383:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:2.0:1788970137.160183:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970137.160296:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732118912 00000100:00100000:1.0:1788970137.160310:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732118912 00000100:00100000:1.0:1788970137.160387:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:1.0:1788970137.160401:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+35:14524:x1875870732118912:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970137.160479:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970137.160513:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b5178 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edd6 expref: 35 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160534:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:1.0:1788970137.160548:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970137.160576:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160592:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160603:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160639:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160647:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160654:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160748:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160767:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160776:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160783:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970137.160829:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160839:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160857:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970137.160861:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970137.160865:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160871:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93c00/0x5d0de860b05b5186 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160889:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160896:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160903:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160909:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970137.160912:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160919:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160926:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb7881a52 (ffff9778519abd00) 00010000:00010000:1.0:1788970137.160929:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970137.160932:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.160937:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b518d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb7881a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970137.161041:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+34:14524:x1875870732118912:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 644us (873us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970137.161049:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:1.0:1788970137.166833:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970137.167075:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732119040 00000100:00100000:0.0:1788970137.167087:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732119040 00000100:00100000:0.0:1788970137.167170:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:0.0:1788970137.167181:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+34:14524:x1875870732119040:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970137.167210:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970137.167240:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5194 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eddd expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.167284:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b519b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.167300:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b519b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.167314:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b519b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.167442:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b5194 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eddd expref: 36 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.167462:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b519b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eddd expref: 35 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.167485:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:0.0:1788970137.167489:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788970137.167493:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4a00, rc 0) 00000100:00100000:0.0:1788970137.167565:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+35:14524:x1875870732119040:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 386us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970137.167572:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:0.0:1788970137.175370:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970137.175491:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732119296 00000100:00100000:1.0:1788970137.175504:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732119296 00000100:00100000:1.0:1788970137.175598:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:1.0:1788970137.175610:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+35:14524:x1875870732119296:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970137.175745:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.175766:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.175780:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970137.176405:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788970137.176418:0:14389:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 449139627869ns, next at 450139625141ns, rc = 0 00000004:00010000:1.0:1788970137.176515:0:14389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b53ed13 reply state 00000000d3ddc772 transno 8589934622 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970137.176527:0:14389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970137.177097:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+37:14524:x1875870732119296:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 1485us (1739us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788970137.177115:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:1.0:1788970137.186941:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1788970137.187117:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.187133:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.187142:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.187150:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.187156:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.187165:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.187185:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:3.0:1788970137.187211:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788970137.187219:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.187226:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92c00/0x5d0de860b05b51a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970137.187298:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732119424 00000100:00100000:0.0:1788970137.187310:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732119424 00000100:00100000:0.0:1788970137.187377:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:0.0:1788970137.187387:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+36:14524:x1875870732119424:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970137.187423:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970137.187444:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ede4 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.187518:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ede4 expref: 37 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.187534:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ede4 expref: 37 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.187554:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:0.0:1788970137.187557:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970137.187560:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5000, rc 0) 00000100:00100000:0.0:1788970137.187632:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+37:14524:x1875870732119424:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 246us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970137.187645:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 54 00000100:00100000:2.0:1788970137.191455:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970137.191560:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732119552 00000100:00100000:0.0:1788970137.191573:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732119552 00000100:00100000:0.0:1788970137.191650:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:0.0:1788970137.191661:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977865086580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2354:x1875870732119552:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788970137.192508:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977865086580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2354:x1875870732119552:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 845us (1062us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788970137.192518:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:1.0:1788970137.217002:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970137.218544:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732119808 00000100:00100000:2.0:1788970137.218561:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732119808 00000100:00100000:2.0:1788970137.218659:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1788970137.218671:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878938f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+37:14524:x1875870732119808:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788970137.219017:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878938f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+38:14524:x1875870732119808:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 348us (2029us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788970137.219025:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:1.0:1788970137.223016:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.223348:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732120064 00000100:00100000:3.0:1788970137.223361:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732120064 00000100:00100000:3.0:1788970137.223440:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:3.0:1788970137.223450:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977878939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+38:14524:x1875870732120064:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970137.223589:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977878939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+38:14524:x1875870732120064:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 141us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970137.223597:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 55 00000100:00100000:0.0:1788970137.231562:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.232004:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732120192 00000100:00100000:3.0:1788970137.232019:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732120192 00000100:00100000:3.0:1788970137.232099:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:3.0:1788970137.232140:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+38:14524:x1875870732120192:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970137.232168:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970137.232199:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edeb expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.232304:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.232323:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.232337:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970137.232402:0:14388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970137.232425:0:14388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.232454:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edeb expref: 40 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.232477:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edeb expref: 39 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.232486:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:3.0:1788970137.232490:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788970137.232494:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778414a8200, rc 0) 00000100:00100000:3.0:1788970137.232569:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+39:14524:x1875870732120192:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 460us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970137.232576:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 56 00000100:00100000:0.0:1788970137.237139:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970137.237290:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732120320 00000100:00100000:1.0:1788970137.237302:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732120320 00000100:00100000:1.0:1788970137.237370:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1788970137.237383:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977845377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2353:x1875870732120320:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970137.237407:0:15074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970137.237435:0:15074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edf2 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970137.237488:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa18499, blocks: 0x1 00010000:00010000:1.0:1788970137.237512:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788970137.237518:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970137.237528:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf2 expref: 7 pid: 15074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.237556:0:15074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf2 expref: 7 pid: 15074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.237570:0:15074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92000, rc 0) 00000100:00100000:1.0:1788970137.237884:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977845377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:2353:x1875870732120320:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 503us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970137.237893:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1788970137.255213:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.255303:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732120576 00000100:00100000:3.0:1788970137.255316:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732120576 00000100:00100000:3.0:1788970137.255388:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:3.0:1788970137.255409:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787893b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+39:14524:x1875870732120576:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970137.255544:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787893b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+39:14524:x1875870732120576:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 146us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970137.255551:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 57 00000100:00100000:0.0:1788970137.260034:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.260125:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732120704 00000100:00100000:3.0:1788970137.260137:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732120704 00000100:00100000:3.0:1788970137.260209:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:3.0:1788970137.260237:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778453770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+39:14524:x1875870732120704:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788970137.307858:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:2.0:1788970137.307883:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788970137.307889:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788970137.307908:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1788970137.307917:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000001:00080000:2.0:1788970137.307953:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1788970137.307980:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788970137.308204:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741534592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788970137.308296:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970137.308512:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778453770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+13:14524:x1875870732120704:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 48273us (48488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970137.308524:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 58 00000100:00100000:3.0:1788970137.310900:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970137.310988:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741534592 00000100:00100000:1.0:1788970137.310999:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741534592 00000100:00100000:1.0:1788970137.311069:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732120832 00000100:00100000:1.0:1788970137.311072:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732120832 00000100:00100000:1.0:1788970137.311092:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970137.311102:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741534592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788970137.311337:0:15072:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788970137.311341:0:15072:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788970137.311343:0:15072:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788970137.311346:0:15072:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788970137 -> 1788970137 00002000:00010000:1.0:1788970137.311349:0:15072:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:3.0:1788970137.311444:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970137.311950:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:0.0:1788970137.311963:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:2354:x1875870732120832:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788970137.312043:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:2354:x1875870732120832:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 84us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970137.312050:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:3.0:1788970137.313916:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970137.314020:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732121088 00000100:00100000:0.0:1788970137.314031:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732121088 00000100:00100000:0.0:1788970137.314091:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:0.0:1788970137.314099:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+13:14524:x1875870732121088:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788970137.314170:0:14390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970137.314204:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edeb expref: 13 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.314250:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:0.0:1788970137.314256:0:14390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970137.314297:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.314314:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.314325:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970137.314638:0:14390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000720470e4 reply state 000000008d8d4872 transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970137.314649:0:14390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970137.314755:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+14:14524:x1875870732121088:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 656us (847us total) trans 8589934624 rc 0/0 00000100:00100000:0.0:1788970137.314763:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 59 00000100:00100000:3.0:1788970137.317774:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1788970137.324880:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.324905:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.324914:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.324922:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970137.324928:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.324958:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.324980:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:0.0:1788970137.324983:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970137.324989:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.324996:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b51c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970137.325053:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732121216 00000100:00100000:0.0:1788970137.325065:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732121216 00000100:00100000:0.0:1788970137.325133:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:0.0:1788970137.325144:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:14524:x1875870732121216:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970137.325165:0:15654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970137.325187:0:15654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4edf9 expref: -99 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.325225:0:15654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf2 expref: 8 pid: 15074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.325236:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970137.325241:0:15654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970137.325247:0:15654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 8 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.325300:0:15654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf2 expref: 8 pid: 15074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.325319:0:15654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf2 expref: 8 pid: 15074 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970137.325337:0:15654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778453743c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15654:1875870741534720:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970137.325442:0:15654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778813a9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788970137.326647:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875870741534592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 15541us (18345us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788970137.326660:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970137.328141:0:15654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778453743c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15654:1875870741534720:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970137.328182:0:15654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 8 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.328207:0:15654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5800, rc 0) 00000100:00100000:0.0:1788970137.328272:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+8:14524:x1875870732121216:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 3128us (10519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970137.328281:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:0.0:1788970137.330741:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970137.330843:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732121344 00000100:00100000:1.0:1788970137.330855:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732121344 00010000:00010000:1.0:1788970137.330903:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf2 expref: 8 pid: 15074 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970137.330948:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:1.0:1788970137.330957:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778453743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+8:2354:x1875870732121344:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970137.330975:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970137.331001:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf2 expref: 8 pid: 15074 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.331017:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf2 expref: 8 pid: 15074 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.331044:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf2 expref: 8 pid: 15074 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.331065:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970137.331070:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970137.331078:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 7 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.331090:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 7 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.331164:0:14374:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 7 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970137.331180:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e90f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14374:1875870741534848:192.168.202.9@tcp:105: 00000100:00100000:1.0:1788970137.331277:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970137.334477:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e90f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14374:1875870741534848:192.168.202.9@tcp:105: 00010000:00010000:1.0:1788970137.334512:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970137.334583:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778453743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:2354:x1875870732121344:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3625us (3850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970137.334596:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000004:00080000:2.0:1788970137.343014:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff977880e92580/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788970137.343035:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741534592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788970137.346170:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.346270:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732121472 00000100:00100000:3.0:1788970137.346283:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732121472 00000100:00100000:3.0:1788970137.346358:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:3.0:1788970137.346372:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:2353:x1875870732121472:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788970137.346661:0:15073:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788970137.346665:0:15073:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788970137 00002000:00010000:3.0:1788970137.346669:0:15073:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788970134 00002000:00010000:3.0:1788970137.346671:0:15073:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788970137 -> 1788970137 00002000:00010000:3.0:1788970137.346683:0:15073:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788970137.346768:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+8:2353:x1875870732121472:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 398us (610us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788970137.346776:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1788970137.360184:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970137.360303:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732121600 00000100:00100000:1.0:1788970137.360315:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732121600 00000100:00100000:1.0:1788970137.360383:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:1.0:1788970137.360402:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+8:2355:x1875870732121600:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788970137.360461:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.360487:0:15072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 8 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.360498:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970137.360503:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970137.360509:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.360570:0:15072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 8 pid: 15654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.360589:0:15072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 8 pid: 15654 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970137.360606:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e90f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15072:1875870741534976:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970137.360725:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785362bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970137.365870:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e90f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15072:1875870741534976:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970137.365913:0:15072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970137.367441:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970137.367547:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732121728 00000100:00100000:2.0:1788970137.367558:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732121728 00010000:00010000:2.0:1788970137.367614:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 9 pid: 15654 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970137.367691:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788970137.367702:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+9:2354:x1875870732121728:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970137.367723:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970137.367753:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 9 pid: 15654 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.367769:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 9 pid: 15654 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.367829:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cdf1647/0x5d0de860b05b51cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edf9 expref: 9 pid: 15654 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.367851:0:14375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970137.367856:0:14375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970137.367864:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.367875:0:14375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.367910:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970137.367974:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+8:2354:x1875870732121728:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 274us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970137.367982:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00010000:00010000:1.0:1788970137.368229:0:15072:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.368239:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.368267:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.368274:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.368294:0:15072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.368303:0:15072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970137.368307:0:15072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.368316:0:15072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.368329:0:15072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.368336:0:15072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b51d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970137.368387:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:2355:x1875870732121600:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 7994us (8217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970137.368407:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1788970137.384477:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970137.384601:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732121984 00000100:00100000:2.0:1788970137.384628:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732121984 00000100:00100000:2.0:1788970137.384714:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 60 00000100:00100000:2.0:1788970137.384726:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+13:14524:x1875870732121984:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788970137.384888:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.384910:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.384924:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.385242:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.385257:0:16264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ede4 expref: 14 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.385266:0:16264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.385311:0:16264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ede4 expref: 14 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.385329:0:16264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ede4 expref: 14 pid: 14388 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970137.385347:0:16264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fcbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16264:1875870741535104:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970137.385451:0:16264:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970137.389015:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970137.389119:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732122112 00000100:00100000:1.0:1788970137.389130:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732122112 00010000:00010000:1.0:1788970137.389175:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ede4 expref: 15 pid: 14388 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970137.389229:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1788970137.389258:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+15:2354:x1875870732122112:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970137.389276:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970137.389284:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ede4 expref: 15 pid: 14388 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.389299:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ede4 expref: 15 pid: 14388 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.389323:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:1.0:1788970137.389330:0:14374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.389340:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.389350:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.389371:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970137.389437:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+15:2354:x1875870732122112:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 181us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970137.389444:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00010000:00010000:2.0:1788970137.390740:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b51a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ede4 expref: 14 pid: 14388 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970137.390774:0:16264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fcbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16264:1875870741535104:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970137.390849:0:16264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.390859:0:16264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970137.390866:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970137.391089:0:16264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788970137.391250:0:16264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000001:00080000:2.0:1788970137.391292:0:16264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788970137.391390:0:16264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fcbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16264:1875870741535232:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788970137.391473:0:16264:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970137.391513:0:16264:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786010d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788970137.391692:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741535232 00000100:00100000:1.0:1788970137.391699:0:14393:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741535232 00000100:00100000:1.0:1788970137.391745:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970137.391754:0:14393:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16264:x1875870741535232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788970137.391865:0:14393:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16264:x1875870741535232:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970137.391872:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970137.392447:0:16264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fcbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16264:1875870741535232:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788970137.393171:0:16264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000100:00100000:3.0:1788970137.393254:0:16264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16264:1875870741535360:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788970137.393311:0:16264:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970137.393342:0:16264:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784500ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970137.393934:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741535360 00000100:00100000:2.0:1788970137.393942:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741535360 00000100:00100000:2.0:1788970137.393977:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970137.393985:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16264:x1875870741535360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788970137.394203:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16264:x1875870741535360:12345-0@lo:1000:mdt00_003.0 Request processed in 219us (891us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788970137.394210:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970137.395179:0:16264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16264:1875870741535360:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788970137.395235:0:16264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395247:0:16264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395256:0:16264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395263:0:16264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.395268:0:16264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395277:0:16264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395295:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:3.0:1788970137.395298:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970137.395304:0:16264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395311:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b51e1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395350:0:16264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395358:0:16264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395363:0:16264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395385:0:16264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.395388:0:16264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395501:0:16264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395512:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977858b3ce00) 00010000:00010000:3.0:1788970137.395515:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970137.395523:0:16264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5140 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc8 expref: 17 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395535:0:16264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5140 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc8 expref: 17 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395546:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5140 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc8 expref: 17 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.395587:0:16264:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5140 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc8 expref: 17 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970137.395601:0:16264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16264:1875870741535488:192.168.202.9@tcp:105: 00000100:00100000:3.0:1788970137.395972:0:16264:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784500ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970137.406512:0:16264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778616d5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16264:1875870741535488:192.168.202.9@tcp:105: 00010000:00010000:3.0:1788970137.406553:0:16264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406588:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5139 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406640:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406658:0:16264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406782:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406936:0:16264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406943:0:16264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406949:0:16264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406956:0:16264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.406961:0:16264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406969:0:16264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.406984:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977858b3ce00) 00010000:00010000:3.0:1788970137.406987:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970137.406992:0:16264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.407006:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b51e8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.407018:0:16264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.407024:0:16264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.407030:0:16264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.407036:0:16264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.407039:0:16264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.407045:0:16264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.407054:0:16264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977858b3ce00) 00010000:00010000:3.0:1788970137.407056:0:16264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788970137.407060:0:16264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.407065:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b51da lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970137.408053:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+17:14524:x1875870732121984:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 23321us (23583us total) trans 8589934629 rc 0/0 00000100:00100000:3.0:1788970137.408068:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 60 00000020:00080000:3.0:1788970137.408086:0:16264:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788970137.408222:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.410045:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732122240 00000100:00100000:3.0:1788970137.410061:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732122240 00000040:00080000:2.0:1788970137.411885:0:14422:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788970137.411894:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970137.411928:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788970137.411940:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788970137.418403:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1788970137.418437:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+17:14522:x1875870732122240:12345-192.168.202.9@tcp:49:bash.0 00000100:00100000:3.0:1788970137.418753:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+17:14522:x1875870732122240:12345-192.168.202.9@tcp:49:bash.0 Request processed in 333us (10531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970137.418950:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.419178:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1788970137.427554:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732122496 00000100:00100000:3.0:1788970137.427573:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732122496 00000100:00100000:3.0:1788970137.428524:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:3.0:1788970137.428545:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+17:14524:x1875870732122496:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788970137.428866:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970137.428994:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732122624 00000100:00100000:0.0:1788970137.429001:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732122624 00000100:00100000:0.0:1788970137.429046:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:0.0:1788970137.429053:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+7:14522:x1875870732122624:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970137.429065:0:15073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970137.429092:0:15073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b51ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ee00 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970137.429133:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa18499, atime: 0x6aa18496, ctime: 0x6aa18499, blocks: 0x1 00010000:00010000:0.0:1788970137.429156:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788970137.429162:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970137.429173:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b51ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee00 expref: 8 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.429194:0:15073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b51ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee00 expref: 8 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.429208:0:15073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5600, rc 0) 00000100:00100000:0.0:1788970137.429273:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+8:14522:x1875870732122624:12345-192.168.202.9@tcp:101:bash.0 Request processed in 220us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970137.429280:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000004:00080000:3.0:1788970137.432617:0:14392:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788970137.433186:0:14392:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00010000:00010000:3.0:1788970137.433280:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.433302:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.433316:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.433326:0:14392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.433333:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.433340:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.433780:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788970137.434008:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+19:14524:x1875870732122496:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 5465us (15053us total) trans 8589934631 rc 0/0 00000100:00100000:3.0:1788970137.434021:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000020:00080000:3.0:1788970137.434028:0:14392:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788970137.435272:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.437937:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732122880 00000100:00100000:3.0:1788970137.437957:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732122880 00000100:00100000:3.0:1788970137.438025:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:3.0:1788970137.438036:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778616d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+19:14522:x1875870732122880:12345-192.168.202.9@tcp:35:bash.0 00000001:00080000:3.0:1788970137.439056:0:14392:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1788970137.439226:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778616d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+21:14522:x1875870732122880:12345-192.168.202.9@tcp:35:bash.0 Request processed in 1190us (3959us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1788970137.439236:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00000020:00080000:3.0:1788970137.439243:0:14392:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788970137.439316:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970137.439328:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.439340:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970137.439352:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.439363:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.439383:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:0.0:1788970137.439386:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788970137.439392:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.440148:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8200/0x5d0de860b05b51f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970137.441879:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970137.441887:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970137.441890:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970137.627124:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970137.628899:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732123136 00000100:00100000:0.0:1788970137.628917:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732123136 00000100:00100000:0.0:1788970137.629014:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:0.0:1788970137.629026:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f465680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+21:14534:x1875870732123136:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970137.629062:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970137.629091:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b51fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ee07 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970137.629285:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788970137.631978:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b51fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee07 expref: 23 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.632006:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:0.0:1788970137.632009:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970137.632017:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5800/0x5d0de860b05b51fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee07 expref: 23 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970137.632051:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5800, rc 0) 00000100:00100000:0.0:1788970137.633519:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f465680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+22:14534:x1875870732123136:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 4480us (6404us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1788970137.633536:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 61 00000100:00100000:1.0:1788970137.643786:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.643977:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732123264 00000100:00100000:3.0:1788970137.643991:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732123264 00000100:00100000:3.0:1788970137.644081:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:3.0:1788970137.644092:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+22:14534:x1875870732123264:12345-192.168.202.9@tcp:34:lfs.0 00010000:00010000:3.0:1788970137.644251:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.644274:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.644289:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.644648:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.644659:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.644667:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.645156:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.645167:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.646542:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970137.647158:0:14388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.647312:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.647321:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.647328:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.647334:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.647340:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.647371:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.647389:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:3.0:1788970137.647393:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970137.647400:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.647406:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8a00/0x5d0de860b05b520b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.647429:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.647435:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.648547:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.648555:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a8000 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.648559:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.648568:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.648583:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff977858b3c700) 00010000:00010000:3.0:1788970137.648586:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970137.648591:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.649841:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8000/0x5d0de860b05b5212 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.649880:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.649887:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.649894:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.649899:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778414a9800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970137.649902:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.649909:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.649921:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977858b3ce00) 00010000:00010000:3.0:1788970137.649924:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970137.649928:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970137.649935:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9800/0x5d0de860b05b5219 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970137.651244:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+22:14534:x1875870732123264:12345-192.168.202.9@tcp:34:lfs.0 Request processed in 7141us (7462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970137.651260:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 62 00000100:00100000:1.0:1788970137.660893:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970137.661071:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732123520 00000100:00100000:3.0:1788970137.661086:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732123520 00000100:00100000:3.0:1788970137.661186:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:3.0:1788970137.661200:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+22:14534:x1875870732123520:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1788970137.661533:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+23:14534:x1875870732123520:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 336us (654us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788970137.661542:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00010000:00010000:1.0:1788970137.870252:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970138.569337:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741535616:0@lo:400:kworker.0 00000100:00100000:1.0:1788970138.569446:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970138.569507:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741536128:0@lo:400:kworker.0 00000100:00100000:1.0:1788970138.569539:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970138.569580:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970138.569586:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741536000:0@lo:400:kworker.0 00000100:00100000:1.0:1788970138.569615:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970138.569650:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741535744:0@lo:400:kworker.0 00000100:00100000:1.0:1788970138.569686:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970138.569705:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741536256:0@lo:400:kworker.0 00000100:00100000:1.0:1788970138.569724:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970138.569740:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970138.569745:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741535872:0@lo:400:kworker.0 00000100:00100000:1.0:1788970138.570006:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970138.570047:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741535616 00000100:00100000:1.0:1788970138.570057:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741535616 00000100:00100000:1.0:1788970138.570125:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788970138.570137:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:3286:x1875870741535616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970138.570233:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741536128 00000100:00100000:2.0:1788970138.570239:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741536128 00000100:00100000:2.0:1788970138.570279:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741536000 00000100:00100000:2.0:1788970138.570282:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741536000 00000100:00100000:2.0:1788970138.570296:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741536256 00000100:00100000:2.0:1788970138.570299:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741536256 00000100:00100000:2.0:1788970138.570315:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788970138.570322:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741536128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970138.570477:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741536128:12345-0@lo:400:kworker.0 Request processed in 153us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970138.570479:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:3286:x1875870741535616:12345-0@lo:400:kworker.0 Request processed in 343us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970138.570490:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788970138.570509:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788970138.570516:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788970138.570525:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741536000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970138.570552:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788970138.570558:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741536000:12345-0@lo:400:kworker.0 Request processed in 34us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970138.570564:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741536256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970138.570569:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788970138.570606:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741536256:12345-0@lo:400:kworker.0 Request processed in 46us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970138.570612:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788970138.570634:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741535744 00000100:00100000:1.0:1788970138.570638:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741535744 00000100:00100000:1.0:1788970138.570667:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741535872 00000100:00100000:1.0:1788970138.570670:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741535872 00000100:00100000:1.0:1788970138.570688:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788970138.570694:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741535744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970138.570723:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741535744:12345-0@lo:400:kworker.0 Request processed in 29us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970138.570729:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788970138.570739:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788970138.570745:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1875870741535872:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788970138.574867:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970138.574879:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970138.574961:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741536384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970138.576589:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741535744:0@lo:400:kworker.0 00000100:00100000:2.0:1788970138.576612:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741536256:0@lo:400:kworker.0 00000100:00100000:2.0:1788970138.576653:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741536000:0@lo:400:kworker.0 00000100:00100000:2.0:1788970138.576666:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741535616:0@lo:400:kworker.0 00000100:00100000:2.0:1788970138.576680:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741536128:0@lo:400:kworker.0 00000100:00100000:3.0:1788970138.584897:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970138.585006:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741536384 00000100:00100000:3.0:1788970138.585018:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741536384 00000100:00100000:3.0:1788970138.585080:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970138.585091:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3284:x1875870741536384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970138.585149:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788970138.585216:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f466940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3284:x1875870741536384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970138.585224:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970138.585289:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741536384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970138.588637:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1875870741535872:12345-0@lo:400:kworker.0 Request processed in 17882us (18621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970138.588654:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788970138.591005:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741535872:0@lo:400:kworker.0 00000001:00080000:3.0:1788970138.641336:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:3.0:1788970138.641365:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:3.0:1788970138.641373:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1788970138.641381:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00010000:00010000:1.0:1788970138.893891:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788970139.341074:0:16658:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788970139.909607:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970140.621186:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970140.621226:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741536512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970140.621336:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970140.621410:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741536512 00000100:00100000:0.0:1788970140.621430:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741536512 00000100:00080000:3.0:1788970140.621481:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970140.621508:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788970140.621521:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741536512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970140.621555:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970140.621650:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741536512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970140.621657:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970140.621843:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741536512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970140.738743:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970140.738834:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970140.739023:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732123776 00000100:00100000:2.0:1788970140.739032:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732123776 00000100:00100000:2.0:1788970140.739114:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1788970140.739126:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2356:x1875870732123776:12345-192.168.202.9@tcp:16:kworker.0 00000100:00100000:2.0:1788970140.739248:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2356:x1875870732123776:12345-192.168.202.9@tcp:16:kworker.0 Request processed in 125us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970140.739256:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:1.0:1788970140.740125:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732123648 00000100:00100000:1.0:1788970140.740133:0:15078:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732123648 00002000:00100000:1.0:1788970140.740164:0:15078:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff97787f359680 x1875870732123648/t0(0) o4->37f81da6-3302-422f-ab81-440f8fa5e2ee@192.168.202.9@tcp:671/0 lens 504/0 e 0 to 0 dl 1788970151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788970140.740193:0:15078:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787f359680 with x1875870732123648 ext(0->8) 00002000:00010000:1.0:1788970140.740199:0:15078:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787f359680 00000100:00100000:1.0:1788970140.740228:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:1.0:1788970140.740236:0:15078:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2356:x1875870732123648:12345-192.168.202.9@tcp:4:bash.0 00000100:00080000:3.0:1788970140.740683:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970140.742341:0:15078:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+8:2356:x1875870732123648:12345-192.168.202.9@tcp:4:bash.0 Request processed in 2098us (3599us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788970140.742353:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00002000:00100000:1.0:1788970140.742364:0:15078:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff97787f359680 x1875870732123648/t8589934598(0) o4->37f81da6-3302-422f-ab81-440f8fa5e2ee@192.168.202.9@tcp:671/0 lens 504/448 e 0 to 0 dl 1788970151 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788970140.742376:0:15078:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97787f359680 with x1875870732123648 ext(0->8) 00002000:00010000:1.0:1788970140.742383:0:15078:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97787f359680 00010000:00010000:1.0:1788970140.936901:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970141.509660:0:14422:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788970141.509670:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970141.509703:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788970141.509710:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 29349 lines, 29349 kept, 0 dropped, 0 bad.